Apr 13 22:48:35 user nova-compute[71269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 22:48:37 user nova-compute[71269]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71269) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 22:48:37 user nova-compute[71269]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71269) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 22:48:37 user nova-compute[71269]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71269) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 22:48:37 user nova-compute[71269]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 22:48:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:48:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:48:38 user nova-compute[71269]: INFO nova.virt.driver [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 22:48:38 user nova-compute[71269]: INFO nova.compute.provider_config [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Acquiring lock "singleton_lock" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Acquired lock "singleton_lock" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Releasing lock "singleton_lock" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Full set of CONF: {{(pid=71269) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ******************************************************************************** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Configuration options gathered from: {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ================================================================================ {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] allow_resize_to_same_host      = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] arq_binding_timeout            = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] backdoor_port                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] backdoor_socket                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] block_device_allocate_retries  = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] block_device_allocate_retries_interval = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cert                           = self.pem {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute_monitors               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] config_dir                     = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] config_drive_format            = iso9660 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] config_source                  = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] console_host                   = user {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] control_exchange               = nova {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cpu_allocation_ratio           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] daemon                         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] debug                          = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] default_access_ip_network_name = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] default_availability_zone      = nova {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] default_ephemeral_format       = ext4 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] default_schedule_zone          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] disk_allocation_ratio          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] enable_new_services            = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] enabled_ssl_apis               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] flat_injected                  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] force_config_drive             = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] force_raw_images               = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] graceful_shutdown_timeout      = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] heal_instance_info_cache_interval = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] host                           = user {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_build_timeout         = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_delete_interval       = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_name_template         = instance-%08x {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_usage_audit           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_usage_audit_period    = month {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] internal_service_availability_zone = internal {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] key                            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] live_migration_retry_count     = 30 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_config_append              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_dir                        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_file                       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_options                    = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_rotate_interval            = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_rotate_interval_type       = days {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] log_rotation_type              = none {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] long_rpc_timeout               = 1800 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_concurrent_builds          = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_concurrent_live_migrations = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_concurrent_snapshots       = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_local_block_devices        = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_logfile_count              = 30 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] max_logfile_size_mb            = 200 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] maximum_instance_delete_attempts = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metadata_listen                = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metadata_listen_port           = 8775 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metadata_workers               = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] migrate_max_retries            = -1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] mkisofs_cmd                    = genisoimage {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] my_ip                          = 10.0.0.210 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] network_allocate_retries       = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] osapi_compute_listen_port      = 8774 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] osapi_compute_unique_server_name_scope =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] osapi_compute_workers          = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] password_length                = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] periodic_enable                = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] periodic_fuzzy_delay           = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] pointer_model                  = ps2mouse {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] preallocate_images             = none {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] publish_errors                 = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] pybasedir                      = /opt/stack/nova {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ram_allocation_ratio           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rate_limit_burst               = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rate_limit_except_level        = CRITICAL {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rate_limit_interval            = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reboot_timeout                 = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reclaim_instance_interval      = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] record                         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reimage_timeout_per_gb         = 20 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] report_interval                = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rescue_timeout                 = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reserved_host_cpus             = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reserved_host_disk_mb          = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reserved_host_memory_mb        = 512 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] reserved_huge_pages            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] resize_confirm_window          = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] resize_fs_using_block_device   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] resume_guests_state_on_host_boot = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rpc_response_timeout           = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] run_external_periodic_tasks    = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] running_deleted_instance_action = reap {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] running_deleted_instance_timeout = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler_instance_sync_interval = 120 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_down_time              = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] servicegroup_driver            = db {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] shelved_offload_time           = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] shelved_poll_interval          = 3600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] shutdown_timeout               = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] source_is_ipv6                 = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ssl_only                       = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] state_path                     = /opt/stack/data/nova {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] sync_power_state_interval      = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] sync_power_state_pool_size     = 1000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] syslog_log_facility            = LOG_USER {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] tempdir                        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] timeout_nbd                    = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] transport_url                  = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] update_resources_interval      = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_cow_images                 = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_eventlog                   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_journal                    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_json                       = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_rootwrap_daemon            = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_stderr                     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] use_syslog                     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vcpu_pin_set                   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plugging_is_fatal          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plugging_timeout           = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] virt_mkfs                      = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] volume_usage_poll_interval     = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] watch_log_file                 = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] web                            = /usr/share/spice-html5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_concurrency.disable_process_locking = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.auth_strategy              = keystone {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.compute_link_prefix        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.dhcp_domain                = novalocal {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.enable_instance_password   = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.glance_link_prefix         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.instance_list_per_project_cells = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.list_records_by_skipping_down_cells = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.local_metadata_per_cell    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.max_limit                  = 1000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.metadata_cache_expiration  = 15 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.neutron_default_tenant_id  = default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.use_forwarded_for          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.use_neutron_default_nets   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_dynamic_targets = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_jsonfile_path   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.backend_argument         = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.config_prefix            = cache.oslo {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.dead_timeout             = 60.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.debug_cache_backend      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.enable_retry_client      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.enable_socket_keepalive  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.enabled                  = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.expiration_time          = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.hashclient_retry_attempts = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_dead_retry      = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_password        =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_sasl_enabled    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.memcache_username        =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.proxies                  = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.retry_attempts           = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.retry_delay              = 0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.socket_keepalive_count   = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.socket_keepalive_idle    = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.socket_keepalive_interval = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.tls_allowed_ciphers      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.tls_cafile               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.tls_certfile             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.tls_enabled              = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cache.tls_keyfile              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.auth_section            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.auth_type               = password {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.cafile                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.certfile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.collect_timing          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.cross_az_attach         = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.debug                   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.endpoint_template       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.http_retries            = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.insecure                = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.keyfile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.os_region_name          = RegionOne {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.split_loggers           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cinder.timeout                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.cpu_dedicated_set      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.cpu_shared_set         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.image_type_exclude_list = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.resource_provider_association_refresh = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.shutdown_retry_interval = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] conductor.workers              = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] console.allowed_origins        = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] console.ssl_ciphers            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] console.ssl_minimum_version    = default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] consoleauth.token_ttl          = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.cafile                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.certfile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.collect_timing          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.connect_retries         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.connect_retry_delay     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.endpoint_override       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.insecure                = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.keyfile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.max_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.min_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.region_name             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.service_name            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.service_type            = accelerator {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.split_loggers           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.status_code_retries     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.timeout                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] cyborg.version                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.backend               = sqlalchemy {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.connection            = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.connection_debug      = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.connection_parameters =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.connection_recycle_time = 3600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.connection_trace      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.db_inc_retry_interval = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.db_max_retries        = 20 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.db_max_retry_interval = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.db_retry_interval     = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.max_overflow          = 50 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.max_pool_size         = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.max_retries           = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.mysql_enable_ndb      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.mysql_wsrep_sync_wait = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.pool_timeout          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.retry_interval        = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.slave_connection      = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] database.sqlite_synchronous    = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.backend           = sqlalchemy {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.connection        = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.connection_debug  = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.connection_parameters =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.connection_recycle_time = 3600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.connection_trace  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.db_inc_retry_interval = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.db_max_retries    = 20 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.db_max_retry_interval = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.db_retry_interval = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.max_overflow      = 50 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.max_pool_size     = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.max_retries       = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.mysql_enable_ndb  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.pool_timeout      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.retry_interval    = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.slave_connection  = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] api_database.sqlite_synchronous = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] devices.enabled_mdev_types     = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ephemeral_storage_encryption.enabled = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.api_servers             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.cafile                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.certfile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.collect_timing          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.connect_retries         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.connect_retry_delay     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.debug                   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.default_trusted_certificate_ids = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.enable_certificate_validation = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.enable_rbd_download     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.endpoint_override       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.insecure                = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.keyfile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.max_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.min_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.num_retries             = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.rbd_ceph_conf           =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.rbd_connect_timeout     = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.rbd_pool                =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.rbd_user                =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.region_name             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.service_name            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.service_type            = image {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.split_loggers           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.status_code_retries     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.timeout                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.verify_glance_signatures = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] glance.version                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] guestfs.debug                  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.config_drive_cdrom      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.config_drive_inject_password = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.enable_remotefx         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.instances_path_share    =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.limit_cpu_features      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.use_multipath_io        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.vswitch_name            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] mks.enabled                    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.manager_interval   = 2400 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.precache_concurrency = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.remove_unused_base_images = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] image_cache.subdirectory_name  = _base {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.api_max_retries         = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.api_retry_interval      = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.auth_section            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.auth_type               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.cafile                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.certfile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.collect_timing          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.connect_retries         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.connect_retry_delay     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.endpoint_override       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.insecure                = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.keyfile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.max_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.min_version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.partition_key           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.peer_list               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.region_name             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.serial_console_state_timeout = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.service_name            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.service_type            = baremetal {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.split_loggers           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.status_code_retries     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.timeout                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ironic.version                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] key_manager.fixed_key          = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.barbican_api_version  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.barbican_endpoint     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.barbican_endpoint_type = public {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.barbican_region_name  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.cafile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.certfile              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.collect_timing        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.insecure              = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.keyfile               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.number_of_retries     = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.retry_delay           = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.send_service_user_token = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.split_loggers         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.timeout               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.verify_ssl            = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican.verify_ssl_path       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.auth_section = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.auth_type = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.cafile   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.certfile = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.collect_timing = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.insecure = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.keyfile  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.split_loggers = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] barbican_service_user.timeout  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.approle_role_id          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.approle_secret_id        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.cafile                   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.certfile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.collect_timing           = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.insecure                 = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.keyfile                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.kv_mountpoint            = secret {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.kv_version               = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.namespace                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.root_token_id            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.split_loggers            = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.ssl_ca_crt_file          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.timeout                  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.use_ssl                  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.cafile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.certfile              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.collect_timing        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.connect_retries       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.connect_retry_delay   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.endpoint_override     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.insecure              = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.keyfile               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.max_version           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.min_version           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.region_name           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.service_name          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.service_type          = identity {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.split_loggers         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.status_code_retries   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.timeout               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] keystone.version               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.connection_uri         =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_mode               = custom {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: WARNING oslo_config.cfg [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_power_governor_high = performance {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_power_management   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.device_detach_attempts = 8 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.device_detach_timeout  = 20 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.disk_cachemodes        = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.disk_prefix            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.enabled_perf_events    = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.file_backed_memory     = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.gid_maps               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.hw_disk_discard        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.hw_machine_type        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_rbd_pool        = rbd {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_type            = default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.images_volume_group    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.inject_key             = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.inject_partition       = -2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.inject_password        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.iscsi_iface            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.iser_use_multipath     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_downtime = 500 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_inbound_addr = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_scheme  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_timeout_action = abort {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_tunnelled = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: WARNING oslo_config.cfg [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 22:48:38 user nova-compute[71269]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 22:48:38 user nova-compute[71269]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 22:48:38 user nova-compute[71269]: and ``live_migration_inbound_addr`` respectively.
Apr 13 22:48:38 user nova-compute[71269]: ).  Its value may be silently ignored in the future.
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.live_migration_with_native_tls = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.max_queues             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.nfs_mount_options      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_pcie_ports         = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.pmem_namespaces        = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.quobyte_client_cfg     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rbd_secret_uuid        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rbd_user               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rescue_image_id        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rescue_kernel_id       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.rx_queue_size          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.smbfs_mount_options    =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.snapshot_compression   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.snapshot_image_format  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.sparse_logical_volumes = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.swtpm_enabled          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.swtpm_group            = tss {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.swtpm_user             = tss {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.sysinfo_serial         = unique {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.tx_queue_size          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.uid_maps               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.use_virtio_for_bridges = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.virt_type              = kvm {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.volume_clear           = zero {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.volume_clear_size      = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.volume_use_multipath   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_cache_path   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.auth_section           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.auth_type              = password {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.cafile                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.certfile               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.collect_timing         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.connect_retries        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.connect_retry_delay    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.default_floating_pool  = public {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.endpoint_override      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.extension_sync_interval = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.http_retries           = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.insecure               = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.keyfile                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.max_version            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.min_version            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.ovs_bridge             = br-int {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.physnets               = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.region_name            = RegionOne {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.service_metadata_proxy = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.service_name           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.service_type           = network {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.split_loggers          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.status_code_retries    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.timeout                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] neutron.version                = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] notifications.bdms_in_notifications = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] notifications.default_level    = INFO {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] notifications.notification_format = unversioned {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] notifications.notify_on_state_change = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] pci.alias                      = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] pci.device_spec                = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] pci.report_in_placement        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.auth_section         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.auth_type            = password {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.cafile               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.certfile             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.collect_timing       = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.connect_retries      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.connect_retry_delay  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.default_domain_id    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.default_domain_name  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.domain_id            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.domain_name          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.endpoint_override    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.insecure             = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.keyfile              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.max_version          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.min_version          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.password             = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.project_domain_id    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.project_domain_name  = Default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.project_id           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.project_name         = service {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.region_name          = RegionOne {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.service_name         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.service_type         = placement {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.split_loggers        = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.status_code_retries  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.system_scope         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.timeout              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.trust_id             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.user_domain_id       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.user_domain_name     = Default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.user_id              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.username             = placement {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] placement.version              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.cores                    = 20 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.count_usage_from_placement = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.injected_file_content_bytes = 10240 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.injected_file_path_length = 255 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.injected_files           = 5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.instances                = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.key_pairs                = 100 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.metadata_items           = 128 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.ram                      = 51200 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.recheck_quota            = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.server_group_members     = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] quota.server_groups            = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rdp.enabled                    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.image_metadata_prefilter = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.max_attempts         = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.max_placement_results = 1000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] scheduler.workers              = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.host_subset_size = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.isolated_hosts = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.isolated_images = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.pci_in_placement = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.track_instance_changes = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metrics.required               = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metrics.weight_multiplier      = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] metrics.weight_setting         = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.enabled         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.port_range      = 10000:20000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] serial_console.serialproxy_port = 6083 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.auth_section      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.auth_type         = password {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.cafile            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.certfile          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.collect_timing    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.insecure          = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.keyfile           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.send_service_user_token = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.split_loggers     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] service_user.timeout           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.agent_enabled            = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.enabled                  = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.html5proxy_port          = 6082 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.image_compression        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.jpeg_compression         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.playback_compression     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.server_listen            = 127.0.0.1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.streaming_mode           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] spice.zlib_compression         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] upgrade_levels.baseapi         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] upgrade_levels.cert            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] upgrade_levels.compute         = auto {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] upgrade_levels.conductor       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] upgrade_levels.scheduler       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.cafile = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.certfile = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.insecure = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vendordata_dynamic_auth.timeout = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.api_retry_count         = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.ca_file                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.cache_prefix            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.cluster_name            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.connection_pool_size    = 10 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.console_delay_seconds   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.datastore_regex         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.host_ip                 = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.host_password           = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.host_port               = 443 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.host_username           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.insecure                = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.integration_bridge      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.maximum_objects         = 100 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.pbm_default_policy      = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.pbm_enabled             = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.pbm_wsdl_location       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.serial_port_proxy_uri   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.serial_port_service_uri = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.task_poll_interval      = 0.5 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.use_linked_clone        = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.vnc_keymap              = en-us {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.vnc_port                = 5900 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vmware.vnc_port_total          = 10000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.auth_schemes               = ['none'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.enabled                    = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.novncproxy_port            = 6080 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.vencrypt_ca_certs          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.vencrypt_client_cert       = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vnc.vencrypt_client_key        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.disable_rootwrap   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.enable_numa_live_migration = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.libvirt_disable_apic = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.client_socket_timeout     = 900 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.default_pool_size         = 1000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.keep_alive                = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.max_header_line           = 16384 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.ssl_ca_file               = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.ssl_cert_file             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.ssl_key_file              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.tcp_keepidle              = 600 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] zvm.ca_file                    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] zvm.cloud_connector_url        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] zvm.reachable_timeout          = 300 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.enforce_new_defaults = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.enforce_scope      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.policy_default_rule = default {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.connection_string     = messaging:// {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.enabled               = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.es_doc_type           = notification {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.es_scroll_size        = 10000 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.es_scroll_time        = 2m {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.filter_error_trace    = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.sentinel_service_name = mymaster {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.socket_timeout        = 0.1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] profiler.trace_sqlalchemy      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] remote_debug.host              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] remote_debug.port              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_notifications.retry = -1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.auth_section        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.auth_type           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.cafile              = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.certfile            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.collect_timing      = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.connect_retries     = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.connect_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.endpoint_id         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.endpoint_override   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.insecure            = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.keyfile             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.max_version         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.min_version         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.region_name         = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.service_name        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.service_type        = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.split_loggers       = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.status_code_retries = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.status_code_retry_delay = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.timeout             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.valid_interfaces    = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_limit.version             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_reports.file_event_handler = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] oslo_reports.log_dir           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.group  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] vif_plug_ovs_privileged.user   = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.isolate_vif         = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] os_brick.lock_path             = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.capabilities   = [21] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.group          = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.helper_command = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] privsep_osbrick.user           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.group           = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.helper_command  = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] nova_sys_admin.user            = None {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG oslo_service.service [None req-e53b7e5d-9c5c-4cc0-900a-e0ada1825e00 None None] ******************************************************************************** {{(pid=71269) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 22:48:38 user nova-compute[71269]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Starting native event thread {{(pid=71269) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Starting green dispatch thread {{(pid=71269) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Starting connection event dispatch thread {{(pid=71269) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Connecting to libvirt: qemu:///system {{(pid=71269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd3c32c66b0> {{(pid=71269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd3c32c66b0> {{(pid=71269) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 22:48:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Connection event '1' reason 'None'
Apr 13 22:48:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 22:48:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.mount [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Initialising _HostMountState generation 0 {{(pid=71269) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 22:48:45 user nova-compute[71269]: INFO nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host capabilities <capabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <host>
Apr 13 22:48:45 user nova-compute[71269]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 22:48:45 user nova-compute[71269]:     <cpu>
Apr 13 22:48:45 user nova-compute[71269]:       <arch>x86_64</arch>
Apr 13 22:48:45 user nova-compute[71269]:       <model>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <microcode version='1070'/>
Apr 13 22:48:45 user nova-compute[71269]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='osxsave'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='invtsc'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='rsba'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 22:48:45 user nova-compute[71269]:       <pages unit='KiB' size='4'/>
Apr 13 22:48:45 user nova-compute[71269]:       <pages unit='KiB' size='2048'/>
Apr 13 22:48:45 user nova-compute[71269]:     </cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <power_management>
Apr 13 22:48:45 user nova-compute[71269]:       <suspend_mem/>
Apr 13 22:48:45 user nova-compute[71269]:       <suspend_disk/>
Apr 13 22:48:45 user nova-compute[71269]:       <suspend_hybrid/>
Apr 13 22:48:45 user nova-compute[71269]:     </power_management>
Apr 13 22:48:45 user nova-compute[71269]:     <iommu support='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <migration_features>
Apr 13 22:48:45 user nova-compute[71269]:       <live/>
Apr 13 22:48:45 user nova-compute[71269]:       <uri_transports>
Apr 13 22:48:45 user nova-compute[71269]:         <uri_transport>tcp</uri_transport>
Apr 13 22:48:45 user nova-compute[71269]:         <uri_transport>rdma</uri_transport>
Apr 13 22:48:45 user nova-compute[71269]:       </uri_transports>
Apr 13 22:48:45 user nova-compute[71269]:     </migration_features>
Apr 13 22:48:45 user nova-compute[71269]:     <topology>
Apr 13 22:48:45 user nova-compute[71269]:       <cells num='2'>
Apr 13 22:48:45 user nova-compute[71269]:         <cell id='0'>
Apr 13 22:48:45 user nova-compute[71269]:           <memory unit='KiB'>8189224</memory>
Apr 13 22:48:45 user nova-compute[71269]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 13 22:48:45 user nova-compute[71269]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 22:48:45 user nova-compute[71269]:           <distances>
Apr 13 22:48:45 user nova-compute[71269]:             <sibling id='0' value='10'/>
Apr 13 22:48:45 user nova-compute[71269]:             <sibling id='1' value='20'/>
Apr 13 22:48:45 user nova-compute[71269]:           </distances>
Apr 13 22:48:45 user nova-compute[71269]:           <cpus num='6'>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 22:48:45 user nova-compute[71269]:           </cpus>
Apr 13 22:48:45 user nova-compute[71269]:         </cell>
Apr 13 22:48:45 user nova-compute[71269]:         <cell id='1'>
Apr 13 22:48:45 user nova-compute[71269]:           <memory unit='KiB'>8218764</memory>
Apr 13 22:48:45 user nova-compute[71269]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 13 22:48:45 user nova-compute[71269]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 22:48:45 user nova-compute[71269]:           <distances>
Apr 13 22:48:45 user nova-compute[71269]:             <sibling id='0' value='20'/>
Apr 13 22:48:45 user nova-compute[71269]:             <sibling id='1' value='10'/>
Apr 13 22:48:45 user nova-compute[71269]:           </distances>
Apr 13 22:48:45 user nova-compute[71269]:           <cpus num='6'>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 22:48:45 user nova-compute[71269]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 22:48:45 user nova-compute[71269]:           </cpus>
Apr 13 22:48:45 user nova-compute[71269]:         </cell>
Apr 13 22:48:45 user nova-compute[71269]:       </cells>
Apr 13 22:48:45 user nova-compute[71269]:     </topology>
Apr 13 22:48:45 user nova-compute[71269]:     <cache>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 22:48:45 user nova-compute[71269]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 22:48:45 user nova-compute[71269]:     </cache>
Apr 13 22:48:45 user nova-compute[71269]:     <secmodel>
Apr 13 22:48:45 user nova-compute[71269]:       <model>apparmor</model>
Apr 13 22:48:45 user nova-compute[71269]:       <doi>0</doi>
Apr 13 22:48:45 user nova-compute[71269]:     </secmodel>
Apr 13 22:48:45 user nova-compute[71269]:     <secmodel>
Apr 13 22:48:45 user nova-compute[71269]:       <model>dac</model>
Apr 13 22:48:45 user nova-compute[71269]:       <doi>0</doi>
Apr 13 22:48:45 user nova-compute[71269]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 22:48:45 user nova-compute[71269]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 22:48:45 user nova-compute[71269]:     </secmodel>
Apr 13 22:48:45 user nova-compute[71269]:   </host>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='alpha'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>clipper</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='armv6l'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>spitz</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>nuri</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>kzm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>z2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>tosa</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n810</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>terrier</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>midway</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>microbit</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>verdex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>highbank</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>akita</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>connex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>collie</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='armv7l'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>spitz</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>nuri</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>kzm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>z2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>tosa</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n810</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>terrier</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>midway</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>microbit</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>verdex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>highbank</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>akita</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>connex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>collie</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='aarch64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>spitz</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>nuri</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>kzm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>z2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>tosa</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n810</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>n800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>terrier</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>midway</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>microbit</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>verdex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>highbank</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>akita</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>connex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>collie</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <acpi default='on' toggle='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='cris'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='i686'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>isapc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>microvm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='kvm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <pae/>
Apr 13 22:48:45 user nova-compute[71269]:       <nonpae/>
Apr 13 22:48:45 user nova-compute[71269]:       <acpi default='on' toggle='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:       <apic default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='m68k'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>an5206</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>q800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='microblaze'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='microblazeel'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='mips'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>malta</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='mipsel'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>malta</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='mips64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>malta</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>pica61</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>magnum</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='mips64el'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>malta</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>pica61</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>magnum</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='16'>boston</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='ppc'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mac99</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>40p</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>taihu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='ppc64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>taihu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>40p</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mac99</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='ppc64le'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>taihu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>40p</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>mac99</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='riscv32'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='8'>spike</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='8'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='riscv64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='8'>spike</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='8'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='s390x'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='sh4'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>shix</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>r2d</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='sh4eb'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>shix</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>r2d</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='sparc'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>LX</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='sparc64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>niagara</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='x86_64'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>64</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='1'>isapc</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>microvm</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='kvm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <acpi default='on' toggle='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:       <apic default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='xtensa'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>sim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>kc705</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ml605</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx200</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx60</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]:   <guest>
Apr 13 22:48:45 user nova-compute[71269]:     <os_type>hvm</os_type>
Apr 13 22:48:45 user nova-compute[71269]:     <arch name='xtensaeb'>
Apr 13 22:48:45 user nova-compute[71269]:       <wordsize>32</wordsize>
Apr 13 22:48:45 user nova-compute[71269]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='4'>sim</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>kc705</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ml605</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>virt</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx200</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>lx60</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 22:48:45 user nova-compute[71269]:       <domain type='qemu'/>
Apr 13 22:48:45 user nova-compute[71269]:     </arch>
Apr 13 22:48:45 user nova-compute[71269]:     <features>
Apr 13 22:48:45 user nova-compute[71269]:       <cpuselection/>
Apr 13 22:48:45 user nova-compute[71269]:       <deviceboot/>
Apr 13 22:48:45 user nova-compute[71269]:       <disksnapshot default='on' toggle='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     </features>
Apr 13 22:48:45 user nova-compute[71269]:   </guest>
Apr 13 22:48:45 user nova-compute[71269]: </capabilities>
Apr 13 22:48:45 user nova-compute[71269]: 
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-q35-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>i686</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='288'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'/>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='lm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-i440fx-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>i686</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='255'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'/>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='lm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ide</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-i440fx-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>i686</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='255'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'/>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='lm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ide</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-q35-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>i686</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='288'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'/>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='lm'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-q35-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>x86_64</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='288'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>efi</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='invtsc'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='rsba'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-i440fx-6.2</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>x86_64</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='255'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>efi</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='invtsc'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='rsba'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ide</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-i440fx-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>x86_64</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='255'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>efi</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='invtsc'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='rsba'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ide</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 22:48:45 user nova-compute[71269]: <domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 22:48:45 user nova-compute[71269]:   <domain>kvm</domain>
Apr 13 22:48:45 user nova-compute[71269]:   <machine>pc-q35-jammy</machine>
Apr 13 22:48:45 user nova-compute[71269]:   <arch>x86_64</arch>
Apr 13 22:48:45 user nova-compute[71269]:   <vcpu max='288'/>
Apr 13 22:48:45 user nova-compute[71269]:   <iothreads supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:   <os supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='firmware'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>efi</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:     <loader supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>rom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pflash</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='readonly'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='secure'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>yes</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>no</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </loader>
Apr 13 22:48:45 user nova-compute[71269]:   </os>
Apr 13 22:48:45 user nova-compute[71269]:   <cpu>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-passthrough' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='hostPassthroughMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='maximum' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='maximumMigratable'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>on</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>off</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='host-model' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <vendor>Intel</vendor>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ss'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='vmx'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pcid'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='hypervisor'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arat'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='umip'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='md-clear'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='invtsc'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibpb'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='ibrs'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-stibp'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='rsba'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='erms'/>
Apr 13 22:48:45 user nova-compute[71269]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:     <mode name='custom' supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>qemu64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>qemu32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>phenom</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>pentium</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>n270</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm64</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>kvm32</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>coreduo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>core2duo</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>athlon</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Westmere</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Snowridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Skylake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>SandyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Penryn</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G5</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G4</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G3</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Opteron_G2</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Opteron_G1</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>IvyBridge</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Icelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Haswell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Rome</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-Milan</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>EPYC</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Dhyana</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cooperlake</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>Conroe</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='no'>Broadwell</model>
Apr 13 22:48:45 user nova-compute[71269]:       <model usable='yes'>486</model>
Apr 13 22:48:45 user nova-compute[71269]:     </mode>
Apr 13 22:48:45 user nova-compute[71269]:   </cpu>
Apr 13 22:48:45 user nova-compute[71269]:   <memoryBacking supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:     <enum name='sourceType'>
Apr 13 22:48:45 user nova-compute[71269]:       <value>file</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>anonymous</value>
Apr 13 22:48:45 user nova-compute[71269]:       <value>memfd</value>
Apr 13 22:48:45 user nova-compute[71269]:     </enum>
Apr 13 22:48:45 user nova-compute[71269]:   </memoryBacking>
Apr 13 22:48:45 user nova-compute[71269]:   <devices>
Apr 13 22:48:45 user nova-compute[71269]:     <disk supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='diskDevice'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>disk</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cdrom</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>floppy</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>lun</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='bus'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>fdc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sata</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </disk>
Apr 13 22:48:45 user nova-compute[71269]:     <graphics supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='type'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>sdl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vnc</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>spice</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egl-headless</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </graphics>
Apr 13 22:48:45 user nova-compute[71269]:     <video supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='modelType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>cirrus</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>vmvga</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>qxl</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>none</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>bochs</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>ramfb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </video>
Apr 13 22:48:45 user nova-compute[71269]:     <hostdev supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='mode'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>subsystem</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='startupPolicy'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>default</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>mandatory</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>requisite</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>optional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='subsysType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>usb</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>pci</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>scsi</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='capsType'/>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='pciBackend'/>
Apr 13 22:48:45 user nova-compute[71269]:     </hostdev>
Apr 13 22:48:45 user nova-compute[71269]:     <rng supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtio-non-transitional</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>random</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>egd</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>builtin</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </rng>
Apr 13 22:48:45 user nova-compute[71269]:     <filesystem supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='driverType'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>path</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>handle</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>virtiofs</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </filesystem>
Apr 13 22:48:45 user nova-compute[71269]:     <tpm supported='yes'>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='model'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-tis</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>tpm-crb</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:       <enum name='backendModel'>
Apr 13 22:48:45 user nova-compute[71269]:         <value>passthrough</value>
Apr 13 22:48:45 user nova-compute[71269]:         <value>emulator</value>
Apr 13 22:48:45 user nova-compute[71269]:       </enum>
Apr 13 22:48:45 user nova-compute[71269]:     </tpm>
Apr 13 22:48:45 user nova-compute[71269]:   </devices>
Apr 13 22:48:45 user nova-compute[71269]:   <features>
Apr 13 22:48:45 user nova-compute[71269]:     <gic supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:     <vmcoreinfo supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <genid supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backingStoreInput supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <backup supported='yes'/>
Apr 13 22:48:45 user nova-compute[71269]:     <sev supported='no'/>
Apr 13 22:48:45 user nova-compute[71269]:   </features>
Apr 13 22:48:45 user nova-compute[71269]: </domainCapabilities>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71269) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71269) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Checking secure boot support for host arch (x86_64) {{(pid=71269) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 22:48:45 user nova-compute[71269]: INFO nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Secure Boot support detected
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] cpu compare xml: <cpu match="exact">
Apr 13 22:48:45 user nova-compute[71269]:   <model>Nehalem</model>
Apr 13 22:48:45 user nova-compute[71269]: </cpu>
Apr 13 22:48:45 user nova-compute[71269]:  {{(pid=71269) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 22:48:45 user nova-compute[71269]: INFO nova.virt.node [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Generated node identity e216f943-de42-42dc-843a-799496cf2730
Apr 13 22:48:45 user nova-compute[71269]: INFO nova.virt.node [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Wrote node identity e216f943-de42-42dc-843a-799496cf2730 to /opt/stack/data/nova/compute_id
Apr 13 22:48:45 user nova-compute[71269]: WARNING nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Compute nodes ['e216f943-de42-42dc-843a-799496cf2730'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 22:48:45 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 22:48:45 user nova-compute[71269]: WARNING nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 22:48:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:48:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:48:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:48:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Hypervisor/Node resource view: name=user free_ram=10880MB free_disk=27.131561279296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:48:46 user nova-compute[71269]: WARNING nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] No compute node record for user:e216f943-de42-42dc-843a-799496cf2730: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e216f943-de42-42dc-843a-799496cf2730 could not be found.
Apr 13 22:48:46 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Compute node record created for user:user with uuid: e216f943-de42-42dc-843a-799496cf2730
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:48:46 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [req-4d680103-f0de-4eb6-a6f2-1d1953fd4dff] Created resource provider record via placement API for resource provider with UUID e216f943-de42-42dc-843a-799496cf2730 and name user.
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71269) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 22:48:46 user nova-compute[71269]: INFO nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] kernel doesn't support AMD SEV
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Libvirt baseline CPU <cpu>
Apr 13 22:48:46 user nova-compute[71269]:   <arch>x86_64</arch>
Apr 13 22:48:46 user nova-compute[71269]:   <model>Nehalem</model>
Apr 13 22:48:46 user nova-compute[71269]:   <vendor>Intel</vendor>
Apr 13 22:48:46 user nova-compute[71269]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 22:48:46 user nova-compute[71269]: </cpu>
Apr 13 22:48:46 user nova-compute[71269]:  {{(pid=71269) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Updated inventory for provider e216f943-de42-42dc-843a-799496cf2730 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Updating resource provider e216f943-de42-42dc-843a-799496cf2730 generation from 0 to 1 during operation: update_inventory {{(pid=71269) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Updating resource provider e216f943-de42-42dc-843a-799496cf2730 generation from 1 to 2 during operation: update_traits {{(pid=71269) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.service [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Creating RPC server for service compute {{(pid=71269) start /opt/stack/nova/nova/service.py:182}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.service [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Join ServiceGroup membership for this service compute {{(pid=71269) start /opt/stack/nova/nova/service.py:199}}
Apr 13 22:48:46 user nova-compute[71269]: DEBUG nova.servicegroup.drivers.db [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71269) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 22:48:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_power_states {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:48:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:49:37 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:49:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:49:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=10195MB free_disk=27.04534912109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:49:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:50:38 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:50:39 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:50:39 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=10174MB free_disk=27.091285705566406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:50:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:50:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:51:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:51:40 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:51:40 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=10137MB free_disk=26.867496490478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:51:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:51:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:52:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:39 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:39 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:52:40 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:52:40 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=9412MB free_disk=26.889373779296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:52:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:52:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:52:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:52:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:52:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:52:44 user nova-compute[71269]: INFO nova.compute.claims [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Claim successful on node user
Apr 13 22:52:44 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:52:45 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:52:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:52:45 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Creating image(s)
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.part --force-share --output=json" returned: 0 in 0.120s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG nova.virt.images [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] d6970ace-53c3-48ed-ae08-e4c3846a312a was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.part /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG nova.policy [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f03ab225421441098f94350bef24442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd502d982f4fe424a8df8149962d46963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.part /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.converted" returned: 0 in 0.179s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f.converted --force-share --output=json" returned: 0 in 0.125s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:46 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf6x776mn/privsep.sock']
Apr 13 22:52:46 user sudo[79988]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf6x776mn/privsep.sock
Apr 13 22:52:46 user sudo[79988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 22:52:47 user sudo[79988]: pam_unix(sudo:session): session closed for user root
Apr 13 22:52:47 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Spawned new privsep daemon via rootwrap
Apr 13 22:52:47 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 22:52:47 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 22:52:47 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 22:52:47 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79992
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.113s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk 1073741824" returned: 0 in 0.078s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Cannot resize image /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG nova.objects.instance [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'migration_context' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Ensure instance console log exists: /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:49 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Successfully created port: 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:52:51 user nova-compute[71269]: INFO nova.compute.claims [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Claim successful on node user
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:52:52 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:52:52 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Creating image(s)
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "/opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "/opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "/opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk 1073741824" returned: 0 in 0.048s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Cannot resize image /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.objects.instance [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lazy-loading 'migration_context' on Instance uuid 636a69ed-f9b3-4b91-b371-7f7bf3e85154 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Ensure instance console log exists: /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Successfully updated port: 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.policy [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcdd77e681f9467db86ff56ff8f516b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c86d23c9fa4c60b53700b0798a215f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing instance network info cache due to event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:52:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.network.neutron [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance network_info: |[{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.network.neutron [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start _get_guest_xml network_info=[{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:52:54 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:52:54 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:52:54 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1424032268',display_name='tempest-ServerStableDeviceRescueTest-server-1424032268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1424032268',id=1,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReEIIBUGN/js2VOAZ0TEIC4I0cZ3TqzAV1r7zPJAF/zIEIbTTJ6VirMRIqofzAmD3hSWWBbJmL3KAKtQPR9xf0O/2/ghxrWTFBBAxj0zncVIMD3cx/w1GJEFykqUBh0Q==',key_name='tempest-keypair-1726987531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d502d982f4fe424a8df8149962d46963',ramdisk_id='',reservation_id='r-ca12h6n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-149870328',owner_user_name='tempest-ServerStableDeviceRescueTest-149870328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f03ab225421441098f94350bef24442',uuid=3f241623-e618-42eb-87d1-0606e37ec499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converting VIF {"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.objects.instance [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:52:55 user nova-compute[71269]:   <uuid>3f241623-e618-42eb-87d1-0606e37ec499</uuid>
Apr 13 22:52:55 user nova-compute[71269]:   <name>instance-00000001</name>
Apr 13 22:52:55 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:52:55 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:52:55 user nova-compute[71269]:   <metadata>
Apr 13 22:52:55 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:52:55 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1424032268</nova:name>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:52:54</nova:creationTime>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:52:55 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:52:55 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:owner>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:user uuid="3f03ab225421441098f94350bef24442">tempest-ServerStableDeviceRescueTest-149870328-project-member</nova:user>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:project uuid="d502d982f4fe424a8df8149962d46963">tempest-ServerStableDeviceRescueTest-149870328</nova:project>
Apr 13 22:52:55 user nova-compute[71269]:       </nova:owner>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:52:55 user nova-compute[71269]:       <nova:ports>
Apr 13 22:52:55 user nova-compute[71269]:         <nova:port uuid="87e984d6-f653-4e7e-a230-53cd27a17d97">
Apr 13 22:52:55 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 22:52:55 user nova-compute[71269]:         </nova:port>
Apr 13 22:52:55 user nova-compute[71269]:       </nova:ports>
Apr 13 22:52:55 user nova-compute[71269]:     </nova:instance>
Apr 13 22:52:55 user nova-compute[71269]:   </metadata>
Apr 13 22:52:55 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:52:55 user nova-compute[71269]:     <system>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="serial">3f241623-e618-42eb-87d1-0606e37ec499</entry>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="uuid">3f241623-e618-42eb-87d1-0606e37ec499</entry>
Apr 13 22:52:55 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:52:55 user nova-compute[71269]:     </system>
Apr 13 22:52:55 user nova-compute[71269]:   </sysinfo>
Apr 13 22:52:55 user nova-compute[71269]:   <os>
Apr 13 22:52:55 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:52:55 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:52:55 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:52:55 user nova-compute[71269]:   </os>
Apr 13 22:52:55 user nova-compute[71269]:   <features>
Apr 13 22:52:55 user nova-compute[71269]:     <acpi/>
Apr 13 22:52:55 user nova-compute[71269]:     <apic/>
Apr 13 22:52:55 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:52:55 user nova-compute[71269]:   </features>
Apr 13 22:52:55 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:52:55 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:52:55 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:52:55 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:52:55 user nova-compute[71269]:   </clock>
Apr 13 22:52:55 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:52:55 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:52:55 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:52:55 user nova-compute[71269]:   </cpu>
Apr 13 22:52:55 user nova-compute[71269]:   <devices>
Apr 13 22:52:55 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:52:55 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:52:55 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk"/>
Apr 13 22:52:55 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:52:55 user nova-compute[71269]:     </disk>
Apr 13 22:52:55 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:52:55 user nova-compute[71269]:       <mac address="fa:16:3e:66:5b:e9"/>
Apr 13 22:52:55 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:52:55 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:52:55 user nova-compute[71269]:       <target dev="tap87e984d6-f6"/>
Apr 13 22:52:55 user nova-compute[71269]:     </interface>
Apr 13 22:52:55 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:52:55 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/console.log" append="off"/>
Apr 13 22:52:55 user nova-compute[71269]:     </serial>
Apr 13 22:52:55 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:52:55 user nova-compute[71269]:     <video>
Apr 13 22:52:55 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:52:55 user nova-compute[71269]:     </video>
Apr 13 22:52:55 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:52:55 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:52:55 user nova-compute[71269]:     </rng>
Apr 13 22:52:55 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:52:55 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:52:55 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:52:55 user nova-compute[71269]:     </memballoon>
Apr 13 22:52:55 user nova-compute[71269]:   </devices>
Apr 13 22:52:55 user nova-compute[71269]: </domain>
Apr 13 22:52:55 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1424032268',display_name='tempest-ServerStableDeviceRescueTest-server-1424032268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1424032268',id=1,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReEIIBUGN/js2VOAZ0TEIC4I0cZ3TqzAV1r7zPJAF/zIEIbTTJ6VirMRIqofzAmD3hSWWBbJmL3KAKtQPR9xf0O/2/ghxrWTFBBAxj0zncVIMD3cx/w1GJEFykqUBh0Q==',key_name='tempest-keypair-1726987531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d502d982f4fe424a8df8149962d46963',ramdisk_id='',reservation_id='r-ca12h6n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-149870328',owner_user_name='tempest-ServerStableDeviceRescueTest-149870328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f03ab225421441098f94350bef24442',uuid=3f241623-e618-42eb-87d1-0606e37ec499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converting VIF {"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG os_vif [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Created schema index Interface.name {{(pid=71269) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Created schema index Port.name {{(pid=71269) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Created schema index Bridge.name {{(pid=71269) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [POLLOUT] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:52:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:52:55 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpas3nhi7g/privsep.sock']
Apr 13 22:52:55 user sudo[80064]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpas3nhi7g/privsep.sock
Apr 13 22:52:55 user sudo[80064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 22:52:56 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Successfully created port: 7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:52:56 user nova-compute[71269]: DEBUG nova.network.neutron [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updated VIF entry in instance network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:52:56 user nova-compute[71269]: DEBUG nova.network.neutron [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:52:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb8640a0-a247-4493-a2c0-2fa551de1dda req-4f55296e-753d-42a0-9929-0231fb350638 service nova] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:52:57 user sudo[80064]: pam_unix(sudo:session): session closed for user root
Apr 13 22:52:57 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Spawned new privsep daemon via rootwrap
Apr 13 22:52:57 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 22:52:57 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 22:52:57 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 22:52:57 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80075
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87e984d6-f6, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87e984d6-f6, col_values=(('external_ids', {'iface-id': '87e984d6-f653-4e7e-a230-53cd27a17d97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5b:e9', 'vm-uuid': '3f241623-e618-42eb-87d1-0606e37ec499'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:57 user nova-compute[71269]: INFO os_vif [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6')
Apr 13 22:52:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No VIF found with MAC fa:16:3e:66:5b:e9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:52:57 user nova-compute[71269]: INFO nova.compute.claims [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Claim successful on node user
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:52:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.124s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:52:58 user nova-compute[71269]: INFO nova.compute.claims [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Claim successful on node user
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:52:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.policy [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:52:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Creating image(s)
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:52:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Successfully updated port: 7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:52:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Creating image(s)
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquired lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk 1073741824" returned: 0 in 0.082s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-changed-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Refreshing instance network info cache due to event network-changed-7c255119-87ff-437e-baec-874090c7c7e4. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:52:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Acquiring lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.163s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.178s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.policy [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Cannot resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'migration_context' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk 1073741824" returned: 0 in 0.061s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Ensure instance console log exists: /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Cannot resize image /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Ensure instance console log exists: /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:52:59 user nova-compute[71269]: INFO nova.compute.claims [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Claim successful on node user
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:52:59 user nova-compute[71269]: WARNING nova.compute.manager [req-fd2ddc36-9a0a-453c-b313-72cc0c86dae1 req-f41c7bed-8bc2-4a32-8b81-f37a8d8eab5a service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state building and task_state spawning.
Apr 13 22:52:59 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updating instance_info_cache with network_info: [{"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Releasing lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Instance network_info: |[{"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Acquired lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.neutron [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Refreshing network info cache for port 7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Start _get_guest_xml network_info=[{"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:53:00 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:00 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1321478870',display_name='tempest-DeleteServersTestJSON-server-1321478870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1321478870',id=2,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c86d23c9fa4c60b53700b0798a215f',ramdisk_id='',reservation_id='r-f2p7wpl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1638372531',owner_user_name='tempest-DeleteServersTestJSON-1638372531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:52Z,user_data=None,user_id='bcdd77e681f9467db86ff56ff8f516b4',uuid=636a69ed-f9b3-4b91-b371-7f7bf3e85154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converting VIF {"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.objects.instance [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lazy-loading 'pci_devices' on Instance uuid 636a69ed-f9b3-4b91-b371-7f7bf3e85154 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:00 user nova-compute[71269]:   <uuid>636a69ed-f9b3-4b91-b371-7f7bf3e85154</uuid>
Apr 13 22:53:00 user nova-compute[71269]:   <name>instance-00000002</name>
Apr 13 22:53:00 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:00 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:00 user nova-compute[71269]:   <metadata>
Apr 13 22:53:00 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:00 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:name>tempest-DeleteServersTestJSON-server-1321478870</nova:name>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:00</nova:creationTime>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:00 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:00 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:user uuid="bcdd77e681f9467db86ff56ff8f516b4">tempest-DeleteServersTestJSON-1638372531-project-member</nova:user>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:project uuid="45c86d23c9fa4c60b53700b0798a215f">tempest-DeleteServersTestJSON-1638372531</nova:project>
Apr 13 22:53:00 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:00 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:00 user nova-compute[71269]:         <nova:port uuid="7c255119-87ff-437e-baec-874090c7c7e4">
Apr 13 22:53:00 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 22:53:00 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:00 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:00 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:00 user nova-compute[71269]:   </metadata>
Apr 13 22:53:00 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:00 user nova-compute[71269]:     <system>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="serial">636a69ed-f9b3-4b91-b371-7f7bf3e85154</entry>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="uuid">636a69ed-f9b3-4b91-b371-7f7bf3e85154</entry>
Apr 13 22:53:00 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:00 user nova-compute[71269]:     </system>
Apr 13 22:53:00 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:00 user nova-compute[71269]:   <os>
Apr 13 22:53:00 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:00 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:00 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:00 user nova-compute[71269]:   </os>
Apr 13 22:53:00 user nova-compute[71269]:   <features>
Apr 13 22:53:00 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:00 user nova-compute[71269]:     <apic/>
Apr 13 22:53:00 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:00 user nova-compute[71269]:   </features>
Apr 13 22:53:00 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:00 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:00 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:00 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:00 user nova-compute[71269]:   </clock>
Apr 13 22:53:00 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:00 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:00 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:00 user nova-compute[71269]:   </cpu>
Apr 13 22:53:00 user nova-compute[71269]:   <devices>
Apr 13 22:53:00 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:00 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:00 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk"/>
Apr 13 22:53:00 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:00 user nova-compute[71269]:     </disk>
Apr 13 22:53:00 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:00 user nova-compute[71269]:       <mac address="fa:16:3e:ee:75:2f"/>
Apr 13 22:53:00 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:00 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:00 user nova-compute[71269]:       <target dev="tap7c255119-87"/>
Apr 13 22:53:00 user nova-compute[71269]:     </interface>
Apr 13 22:53:00 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:00 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/console.log" append="off"/>
Apr 13 22:53:00 user nova-compute[71269]:     </serial>
Apr 13 22:53:00 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:00 user nova-compute[71269]:     <video>
Apr 13 22:53:00 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:00 user nova-compute[71269]:     </video>
Apr 13 22:53:00 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:00 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:00 user nova-compute[71269]:     </rng>
Apr 13 22:53:00 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:00 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:00 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:00 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:00 user nova-compute[71269]:   </devices>
Apr 13 22:53:00 user nova-compute[71269]: </domain>
Apr 13 22:53:00 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1321478870',display_name='tempest-DeleteServersTestJSON-server-1321478870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1321478870',id=2,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c86d23c9fa4c60b53700b0798a215f',ramdisk_id='',reservation_id='r-f2p7wpl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1638372531',owner_user_name='tempest-DeleteServersTestJSON-1638372531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:52Z,user_data=None,user_id='bcdd77e681f9467db86ff56ff8f516b4',uuid=636a69ed-f9b3-4b91-b371-7f7bf3e85154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converting VIF {"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG os_vif [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c255119-87, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c255119-87, col_values=(('external_ids', {'iface-id': '7c255119-87ff-437e-baec-874090c7c7e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:75:2f', 'vm-uuid': '636a69ed-f9b3-4b91-b371-7f7bf3e85154'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:00 user nova-compute[71269]: INFO os_vif [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87')
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] No VIF found with MAC fa:16:3e:ee:75:2f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Creating image(s)
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.policy [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Successfully created port: 94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk 1073741824" returned: 0 in 0.046s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426380.8145237, 3f241623-e618-42eb-87d1-0606e37ec499 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Resumed (Lifecycle Event)
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance spawned successfully.
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.159s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:53:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:00 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426380.8282495, 3f241623-e618-42eb-87d1-0606e37ec499 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:00 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Started (Lifecycle Event)
Apr 13 22:53:01 user nova-compute[71269]: INFO nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Took 15.78 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Cannot resize image /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:01 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Ensure instance console log exists: /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Successfully created port: 6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:01 user nova-compute[71269]: INFO nova.compute.manager [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Took 16.75 seconds to build instance.
Apr 13 22:53:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-541b6f6f-37b0-42fd-ba10-b75c4bfb62d6 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.028s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:53:02 user nova-compute[71269]: INFO nova.compute.claims [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Claim successful on node user
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updated VIF entry in instance network info cache for port 7c255119-87ff-437e-baec-874090c7c7e4. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updating instance_info_cache with network_info: [{"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:02 user nova-compute[71269]: WARNING nova.compute.manager [req-8381a7d6-af8d-409c-8fce-11799889d2ec req-9bab6e68-f9ed-4b32-abad-2bdac31c96a8 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state active and task_state None.
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d1e62f5a-42fb-4216-8015-f4a595f1065f req-4072a87b-ce81-4ac6-a9ed-e734b5ffb2b2 service nova] Releasing lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] No waiting events found dispatching network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:02 user nova-compute[71269]: WARNING nova.compute.manager [req-f49d0ad3-0aa3-4a38-8dc3-a6d6a17503c6 req-224ffe85-c3c5-4919-83d4-90208119f52b service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received unexpected event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 for instance with vm_state building and task_state spawning.
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:53:02 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:53:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:53:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Creating image(s)
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.196s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.policy [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:53:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Successfully created port: ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.216s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk 1073741824" returned: 0 in 0.064s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Successfully updated port: 6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.257s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426384.5697517, 636a69ed-f9b3-4b91-b371-7f7bf3e85154 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] VM Resumed (Lifecycle Event)
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Cannot resize image /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.objects.instance [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'migration_context' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Instance spawned successfully.
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Ensure instance console log exists: /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426384.5704467, 636a69ed-f9b3-4b91-b371-7f7bf3e85154 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] VM Started (Lifecycle Event)
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-changed-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Refreshing instance network info cache due to event network-changed-6566345e-be68-4eb1-90de-e53780e7f8f9. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Took 12.34 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] No waiting events found dispatching network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:04 user nova-compute[71269]: WARNING nova.compute.manager [req-db72035f-d3d4-4553-b3d4-f9e4f1c08478 req-c61ea0bc-76be-4c3f-ba5e-37bbf264a320 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received unexpected event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 for instance with vm_state building and task_state spawning.
Apr 13 22:53:04 user nova-compute[71269]: INFO nova.compute.manager [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Took 13.04 seconds to build instance.
Apr 13 22:53:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9ce26e8a-cb04-4617-b202-d2833ab12da2 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.151s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Successfully updated port: 94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance network_info: |[{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Refreshing network info cache for port 6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start _get_guest_xml network_info=[{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:05 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:05 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442957850',display_name='tempest-ServerRescueNegativeTestJSON-server-1442957850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442957850',id=4,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-40rn7keu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:59Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=df12dd8d-ea02-4c59-804d-52ae1bd4a555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:05 user nova-compute[71269]:   <uuid>df12dd8d-ea02-4c59-804d-52ae1bd4a555</uuid>
Apr 13 22:53:05 user nova-compute[71269]:   <name>instance-00000004</name>
Apr 13 22:53:05 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:05 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:05 user nova-compute[71269]:   <metadata>
Apr 13 22:53:05 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:05 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1442957850</nova:name>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:05</nova:creationTime>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:05 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:05 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 22:53:05 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:05 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:05 user nova-compute[71269]:         <nova:port uuid="6566345e-be68-4eb1-90de-e53780e7f8f9">
Apr 13 22:53:05 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 22:53:05 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:05 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:05 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:05 user nova-compute[71269]:   </metadata>
Apr 13 22:53:05 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:05 user nova-compute[71269]:     <system>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="serial">df12dd8d-ea02-4c59-804d-52ae1bd4a555</entry>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="uuid">df12dd8d-ea02-4c59-804d-52ae1bd4a555</entry>
Apr 13 22:53:05 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:05 user nova-compute[71269]:     </system>
Apr 13 22:53:05 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:05 user nova-compute[71269]:   <os>
Apr 13 22:53:05 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:05 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:05 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:05 user nova-compute[71269]:   </os>
Apr 13 22:53:05 user nova-compute[71269]:   <features>
Apr 13 22:53:05 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:05 user nova-compute[71269]:     <apic/>
Apr 13 22:53:05 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:05 user nova-compute[71269]:   </features>
Apr 13 22:53:05 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:05 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:05 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:05 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:05 user nova-compute[71269]:   </clock>
Apr 13 22:53:05 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:05 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:05 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:05 user nova-compute[71269]:   </cpu>
Apr 13 22:53:05 user nova-compute[71269]:   <devices>
Apr 13 22:53:05 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:05 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:05 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk"/>
Apr 13 22:53:05 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:05 user nova-compute[71269]:     </disk>
Apr 13 22:53:05 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:05 user nova-compute[71269]:       <mac address="fa:16:3e:05:19:3f"/>
Apr 13 22:53:05 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:05 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:05 user nova-compute[71269]:       <target dev="tap6566345e-be"/>
Apr 13 22:53:05 user nova-compute[71269]:     </interface>
Apr 13 22:53:05 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:05 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/console.log" append="off"/>
Apr 13 22:53:05 user nova-compute[71269]:     </serial>
Apr 13 22:53:05 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:05 user nova-compute[71269]:     <video>
Apr 13 22:53:05 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:05 user nova-compute[71269]:     </video>
Apr 13 22:53:05 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:05 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:05 user nova-compute[71269]:     </rng>
Apr 13 22:53:05 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:05 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:05 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:05 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:05 user nova-compute[71269]:   </devices>
Apr 13 22:53:05 user nova-compute[71269]: </domain>
Apr 13 22:53:05 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442957850',display_name='tempest-ServerRescueNegativeTestJSON-server-1442957850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442957850',id=4,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-40rn7keu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:59Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=df12dd8d-ea02-4c59-804d-52ae1bd4a555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG os_vif [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6566345e-be, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6566345e-be, col_values=(('external_ids', {'iface-id': '6566345e-be68-4eb1-90de-e53780e7f8f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:19:3f', 'vm-uuid': 'df12dd8d-ea02-4c59-804d-52ae1bd4a555'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:05 user nova-compute[71269]: INFO os_vif [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be')
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:05:19:3f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updated VIF entry in instance network info cache for port 6566345e-be68-4eb1-90de-e53780e7f8f9. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cc8ca463-0202-4cd2-bd66-2a62cbd8752b req-1314ebba-9e4d-44b5-9090-40518613a0c5 service nova] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-changed-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Refreshing instance network info cache due to event network-changed-94c47f47-2ee7-46d0-858d-a5ff3270a80b. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.neutron [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance network_info: |[{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.neutron [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Refreshing network info cache for port 94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start _get_guest_xml network_info=[{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.objects.instance [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:07 user nova-compute[71269]:   <uuid>92e1fa88-8896-4198-af4d-56d44baf3b9b</uuid>
Apr 13 22:53:07 user nova-compute[71269]:   <name>instance-00000003</name>
Apr 13 22:53:07 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:07 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:07 user nova-compute[71269]:   <metadata>
Apr 13 22:53:07 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:07 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeTestJSON-server-399970293</nova:name>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:07</nova:creationTime>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:07 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:07 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:user uuid="13b46af525dd45678b69207e93683ac4">tempest-AttachVolumeTestJSON-118072319-project-member</nova:user>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:project uuid="d0648ea953174a8cae6085ac24d92bb1">tempest-AttachVolumeTestJSON-118072319</nova:project>
Apr 13 22:53:07 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:07 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:07 user nova-compute[71269]:         <nova:port uuid="94c47f47-2ee7-46d0-858d-a5ff3270a80b">
Apr 13 22:53:07 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:53:07 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:07 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:07 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:07 user nova-compute[71269]:   </metadata>
Apr 13 22:53:07 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:07 user nova-compute[71269]:     <system>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="serial">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="uuid">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 22:53:07 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:07 user nova-compute[71269]:     </system>
Apr 13 22:53:07 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:07 user nova-compute[71269]:   <os>
Apr 13 22:53:07 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:07 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:07 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:07 user nova-compute[71269]:   </os>
Apr 13 22:53:07 user nova-compute[71269]:   <features>
Apr 13 22:53:07 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:07 user nova-compute[71269]:     <apic/>
Apr 13 22:53:07 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:07 user nova-compute[71269]:   </features>
Apr 13 22:53:07 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:07 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:07 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:07 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:07 user nova-compute[71269]:   </clock>
Apr 13 22:53:07 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:07 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:07 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:07 user nova-compute[71269]:   </cpu>
Apr 13 22:53:07 user nova-compute[71269]:   <devices>
Apr 13 22:53:07 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:07 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:07 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk"/>
Apr 13 22:53:07 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:07 user nova-compute[71269]:     </disk>
Apr 13 22:53:07 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:07 user nova-compute[71269]:       <mac address="fa:16:3e:03:14:a3"/>
Apr 13 22:53:07 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:07 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:07 user nova-compute[71269]:       <target dev="tap94c47f47-2e"/>
Apr 13 22:53:07 user nova-compute[71269]:     </interface>
Apr 13 22:53:07 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:07 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/console.log" append="off"/>
Apr 13 22:53:07 user nova-compute[71269]:     </serial>
Apr 13 22:53:07 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:07 user nova-compute[71269]:     <video>
Apr 13 22:53:07 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:07 user nova-compute[71269]:     </video>
Apr 13 22:53:07 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:07 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:07 user nova-compute[71269]:     </rng>
Apr 13 22:53:07 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:07 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:07 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:07 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:07 user nova-compute[71269]:   </devices>
Apr 13 22:53:07 user nova-compute[71269]: </domain>
Apr 13 22:53:07 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG os_vif [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c47f47-2e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c47f47-2e, col_values=(('external_ids', {'iface-id': '94c47f47-2ee7-46d0-858d-a5ff3270a80b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:14:a3', 'vm-uuid': '92e1fa88-8896-4198-af4d-56d44baf3b9b'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:07 user nova-compute[71269]: INFO os_vif [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No VIF found with MAC fa:16:3e:03:14:a3, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:07 user nova-compute[71269]: WARNING nova.compute.manager [req-5abf8eff-ff0d-44a2-a191-d5e46ded092e req-666e7bf8-1aea-4521-956e-89aadc01157c service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state building and task_state spawning.
Apr 13 22:53:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Successfully created port: 822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Successfully updated port: ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-changed-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Refreshing instance network info cache due to event network-changed-ac600f3d-8b2c-4200-81dd-3d35843d3f28. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:09 user nova-compute[71269]: WARNING nova.compute.manager [req-abe2da77-5fbd-4c93-8005-0d175e8f8c23 req-79e4a7db-628e-4e4b-b6be-0312d18080ff service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state building and task_state spawning.
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updated VIF entry in instance network info cache for port 94c47f47-2ee7-46d0-858d-a5ff3270a80b. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b3819bb-fa26-4950-83c6-464f384d5010 req-af485391-1c98-420a-b85b-1ae262403fe4 service nova] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance network_info: |[{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Refreshing network info cache for port ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start _get_guest_xml network_info=[{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1927376719',display_name='tempest-ServerRescueNegativeTestJSON-server-1927376719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1927376719',id=5,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-jsn1bir9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:00Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=ff417f05-3cfa-4274-a0d9-9145ce1e5f83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:10 user nova-compute[71269]:   <uuid>ff417f05-3cfa-4274-a0d9-9145ce1e5f83</uuid>
Apr 13 22:53:10 user nova-compute[71269]:   <name>instance-00000005</name>
Apr 13 22:53:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:10 user nova-compute[71269]:   <metadata>
Apr 13 22:53:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1927376719</nova:name>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:10</nova:creationTime>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 22:53:10 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:10 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:10 user nova-compute[71269]:         <nova:port uuid="ac600f3d-8b2c-4200-81dd-3d35843d3f28">
Apr 13 22:53:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 22:53:10 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:10 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:10 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:10 user nova-compute[71269]:   </metadata>
Apr 13 22:53:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:10 user nova-compute[71269]:     <system>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="serial">ff417f05-3cfa-4274-a0d9-9145ce1e5f83</entry>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="uuid">ff417f05-3cfa-4274-a0d9-9145ce1e5f83</entry>
Apr 13 22:53:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:10 user nova-compute[71269]:     </system>
Apr 13 22:53:10 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:10 user nova-compute[71269]:   <os>
Apr 13 22:53:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:10 user nova-compute[71269]:   </os>
Apr 13 22:53:10 user nova-compute[71269]:   <features>
Apr 13 22:53:10 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:10 user nova-compute[71269]:     <apic/>
Apr 13 22:53:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:10 user nova-compute[71269]:   </features>
Apr 13 22:53:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:10 user nova-compute[71269]:   </clock>
Apr 13 22:53:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:10 user nova-compute[71269]:   </cpu>
Apr 13 22:53:10 user nova-compute[71269]:   <devices>
Apr 13 22:53:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk"/>
Apr 13 22:53:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:10 user nova-compute[71269]:     </disk>
Apr 13 22:53:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:10 user nova-compute[71269]:       <mac address="fa:16:3e:ae:e2:b2"/>
Apr 13 22:53:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:10 user nova-compute[71269]:       <target dev="tapac600f3d-8b"/>
Apr 13 22:53:10 user nova-compute[71269]:     </interface>
Apr 13 22:53:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/console.log" append="off"/>
Apr 13 22:53:10 user nova-compute[71269]:     </serial>
Apr 13 22:53:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:10 user nova-compute[71269]:     <video>
Apr 13 22:53:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:10 user nova-compute[71269]:     </video>
Apr 13 22:53:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:10 user nova-compute[71269]:     </rng>
Apr 13 22:53:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:10 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:10 user nova-compute[71269]:   </devices>
Apr 13 22:53:10 user nova-compute[71269]: </domain>
Apr 13 22:53:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1927376719',display_name='tempest-ServerRescueNegativeTestJSON-server-1927376719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1927376719',id=5,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-jsn1bir9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:00Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=ff417f05-3cfa-4274-a0d9-9145ce1e5f83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG os_vif [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac600f3d-8b, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac600f3d-8b, col_values=(('external_ids', {'iface-id': 'ac600f3d-8b2c-4200-81dd-3d35843d3f28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:e2:b2', 'vm-uuid': 'ff417f05-3cfa-4274-a0d9-9145ce1e5f83'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:10 user nova-compute[71269]: INFO os_vif [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b')
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:ae:e2:b2, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426391.8683474, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:11 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Resumed (Lifecycle Event)
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance spawned successfully.
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:11 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426391.8800368, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:11 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Started (Lifecycle Event)
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Took 13.26 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Took 14.22 seconds to build instance.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-605c2b04-831f-4f39-bf8b-5d505311e163 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.353s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Successfully updated port: 822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquired lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:12 user nova-compute[71269]: WARNING nova.compute.manager [req-635eaea2-8954-4603-9928-f82abd3c85b8 req-6cef8da5-a558-4684-8d53-9e83f25b1b54 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state building and task_state spawning.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-changed-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Refreshing instance network info cache due to event network-changed-822bdb49-5f9a-4949-8543-929b1764e810. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Acquiring lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.network.neutron [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updated VIF entry in instance network info cache for port ac600f3d-8b2c-4200-81dd-3d35843d3f28. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.network.neutron [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426392.6613414, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Resumed (Lifecycle Event)
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3a9d048f-be6b-4531-9d3f-e851fb2ef442 req-cda9299d-8168-49d9-990d-f2ca412a370f service nova] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance spawned successfully.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426392.700716, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Started (Lifecycle Event)
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:12 user nova-compute[71269]: INFO nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Took 14.38 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: INFO nova.compute.manager [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Took 15.35 seconds to build instance.
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dab8d195-200d-49f3-aec9-14e4a4863f1c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.542s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updating instance_info_cache with network_info: [{"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Releasing lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Instance network_info: |[{"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Acquired lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.neutron [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Refreshing network info cache for port 822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Start _get_guest_xml network_info=[{"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-839336931',display_name='tempest-AttachVolumeNegativeTest-server-839336931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-839336931',id=6,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGG8geDVsN5KCbwanV43dcTPubxsRVV396AawS43lH/1wpzCdySaKQyIvqwEs0J64zhA20KaUXLOqWWWOfH1mvUaY2xH6JXuK78xj0Ln04BXM/n5aZkAdtXlI21Ph3uoA==',key_name='tempest-keypair-1288429327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-737ze23t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=0e10dfa7-4997-44b0-b26d-421c7a2d8b63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.objects.instance [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:13 user nova-compute[71269]:   <uuid>0e10dfa7-4997-44b0-b26d-421c7a2d8b63</uuid>
Apr 13 22:53:13 user nova-compute[71269]:   <name>instance-00000006</name>
Apr 13 22:53:13 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:13 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:13 user nova-compute[71269]:   <metadata>
Apr 13 22:53:13 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:13 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-839336931</nova:name>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:13</nova:creationTime>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:13 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:13 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:user uuid="98594f3f6ccf4ffdbfd91bcf192d936e">tempest-AttachVolumeNegativeTest-704876090-project-member</nova:user>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:project uuid="85ccac99656842aca44f9f1eb7aa167a">tempest-AttachVolumeNegativeTest-704876090</nova:project>
Apr 13 22:53:13 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:13 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:13 user nova-compute[71269]:         <nova:port uuid="822bdb49-5f9a-4949-8543-929b1764e810">
Apr 13 22:53:13 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 22:53:13 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:13 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:13 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:13 user nova-compute[71269]:   </metadata>
Apr 13 22:53:13 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:13 user nova-compute[71269]:     <system>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="serial">0e10dfa7-4997-44b0-b26d-421c7a2d8b63</entry>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="uuid">0e10dfa7-4997-44b0-b26d-421c7a2d8b63</entry>
Apr 13 22:53:13 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:13 user nova-compute[71269]:     </system>
Apr 13 22:53:13 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:13 user nova-compute[71269]:   <os>
Apr 13 22:53:13 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:13 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:13 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:13 user nova-compute[71269]:   </os>
Apr 13 22:53:13 user nova-compute[71269]:   <features>
Apr 13 22:53:13 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:13 user nova-compute[71269]:     <apic/>
Apr 13 22:53:13 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:13 user nova-compute[71269]:   </features>
Apr 13 22:53:13 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:13 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:13 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:13 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:13 user nova-compute[71269]:   </clock>
Apr 13 22:53:13 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:13 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:13 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:13 user nova-compute[71269]:   </cpu>
Apr 13 22:53:13 user nova-compute[71269]:   <devices>
Apr 13 22:53:13 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:13 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:13 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk"/>
Apr 13 22:53:13 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:13 user nova-compute[71269]:     </disk>
Apr 13 22:53:13 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:13 user nova-compute[71269]:       <mac address="fa:16:3e:91:66:95"/>
Apr 13 22:53:13 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:13 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:13 user nova-compute[71269]:       <target dev="tap822bdb49-5f"/>
Apr 13 22:53:13 user nova-compute[71269]:     </interface>
Apr 13 22:53:13 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:13 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/console.log" append="off"/>
Apr 13 22:53:13 user nova-compute[71269]:     </serial>
Apr 13 22:53:13 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:13 user nova-compute[71269]:     <video>
Apr 13 22:53:13 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:13 user nova-compute[71269]:     </video>
Apr 13 22:53:13 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:13 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:13 user nova-compute[71269]:     </rng>
Apr 13 22:53:13 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:13 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:13 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:13 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:13 user nova-compute[71269]:   </devices>
Apr 13 22:53:13 user nova-compute[71269]: </domain>
Apr 13 22:53:13 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-839336931',display_name='tempest-AttachVolumeNegativeTest-server-839336931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-839336931',id=6,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGG8geDVsN5KCbwanV43dcTPubxsRVV396AawS43lH/1wpzCdySaKQyIvqwEs0J64zhA20KaUXLOqWWWOfH1mvUaY2xH6JXuK78xj0Ln04BXM/n5aZkAdtXlI21Ph3uoA==',key_name='tempest-keypair-1288429327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-737ze23t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=0e10dfa7-4997-44b0-b26d-421c7a2d8b63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG os_vif [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap822bdb49-5f, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap822bdb49-5f, col_values=(('external_ids', {'iface-id': '822bdb49-5f9a-4949-8543-929b1764e810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:66:95', 'vm-uuid': '0e10dfa7-4997-44b0-b26d-421c7a2d8b63'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:13 user nova-compute[71269]: INFO os_vif [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f')
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:91:66:95, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:14 user nova-compute[71269]: WARNING nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state active and task_state None.
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:14 user nova-compute[71269]: WARNING nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state building and task_state spawning.
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:14 user nova-compute[71269]: WARNING nova.compute.manager [req-fb3c3e45-e6da-49f7-94af-7380ed233ceb req-163b6e97-b383-45eb-9b15-ba5f1e20a9f8 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state building and task_state spawning.
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updated VIF entry in instance network info cache for port 822bdb49-5f9a-4949-8543-929b1764e810. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updating instance_info_cache with network_info: [{"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42c9078b-0613-4ca1-8153-a8f70f9d298a req-0e8072ed-67b2-4bf0-bf7c-f9c99ab23f33 service nova] Releasing lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:53:14 user nova-compute[71269]: INFO nova.compute.claims [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Claim successful on node user
Apr 13 22:53:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:53:15 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:53:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.policy [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Creating image(s)
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "/opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "/opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "/opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.250s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] No waiting events found dispatching network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:16 user nova-compute[71269]: WARNING nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received unexpected event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 for instance with vm_state building and task_state spawning.
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] No waiting events found dispatching network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:16 user nova-compute[71269]: WARNING nova.compute.manager [req-7090131c-4c95-4bae-ac29-27249fd3bc0c req-b222fc64-7b8c-4294-9889-d60e9eb0bb85 service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received unexpected event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 for instance with vm_state building and task_state spawning.
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426396.5746744, ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] VM Resumed (Lifecycle Event)
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance spawned successfully.
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426396.5750175, ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] VM Started (Lifecycle Event)
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.272s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Took 16.42 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk 1073741824" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:16 user nova-compute[71269]: INFO nova.compute.manager [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Took 17.42 seconds to build instance.
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f20b114b-c007-4589-92bc-a5e7effe9a51 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.667s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.205s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Successfully created port: 3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Cannot resize image /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'migration_context' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Ensure instance console log exists: /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:17 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:53:17 user nova-compute[71269]: INFO nova.compute.claims [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Claim successful on node user
Apr 13 22:53:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.863s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426398.3726416, 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] VM Resumed (Lifecycle Event)
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Instance spawned successfully.
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Successfully updated port: 3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquired lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-changed-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Refreshing instance network info cache due to event network-changed-3958622e-6a70-4931-b630-26e0a53c5755. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Acquiring lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426398.3728619, 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] VM Started (Lifecycle Event)
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.policy [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd624ba67e327453881558410a112910a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc753ebae6474a4b8a914b240795df82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Took 15.13 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:53:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Creating image(s)
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "7455f69690b09a411abe9b4f7fd395cf182c3720" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "7455f69690b09a411abe9b4f7fd395cf182c3720" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:19 user nova-compute[71269]: INFO nova.compute.manager [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Took 16.75 seconds to build instance.
Apr 13 22:53:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-287ddd73-5fc7-45d7-94f7-ae74ea1ad9f2 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.050s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.part --force-share --output=json" returned: 0 in 0.185s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG nova.virt.images [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 23f6496f-7550-41f3-a9ce-a6e787316117 was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.part /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:19 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating instance_info_cache with network_info: [{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Releasing lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Instance network_info: |[{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Acquired lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.network.neutron [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Refreshing network info cache for port 3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Start _get_guest_xml network_info=[{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:20 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:20 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1789468832',display_name='tempest-VolumesAdminNegativeTest-server-1789468832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1789468832',id=7,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObF04qfQe1XUBpXGnJngmDi1GmEIreN0d0ZxA7hkpzFUTJv86Fr4EfbN4NCxkHRaIN2RUxi8ku3mcOnyyqemReBiK8NwWityhFwwbgBqfpTW9dedeBA81mDCVtDqQo2+A==',key_name='tempest-keypair-686921666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-kn3txfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=2355fe9d-511a-4e7c-ac2a-5bddc034e063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'pci_devices' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.part /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.converted" returned: 0 in 0.445s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:20 user nova-compute[71269]:   <uuid>2355fe9d-511a-4e7c-ac2a-5bddc034e063</uuid>
Apr 13 22:53:20 user nova-compute[71269]:   <name>instance-00000007</name>
Apr 13 22:53:20 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:20 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:20 user nova-compute[71269]:   <metadata>
Apr 13 22:53:20 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:20 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1789468832</nova:name>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:20</nova:creationTime>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:20 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:20 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:user uuid="e1b08dea04784bc3b07195f951a84bfb">tempest-VolumesAdminNegativeTest-357530992-project-member</nova:user>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:project uuid="a33cf3bf67714b0ba9c7f703a1c9e5b9">tempest-VolumesAdminNegativeTest-357530992</nova:project>
Apr 13 22:53:20 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:20 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:20 user nova-compute[71269]:         <nova:port uuid="3958622e-6a70-4931-b630-26e0a53c5755">
Apr 13 22:53:20 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 22:53:20 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:20 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:20 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:20 user nova-compute[71269]:   </metadata>
Apr 13 22:53:20 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:20 user nova-compute[71269]:     <system>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="serial">2355fe9d-511a-4e7c-ac2a-5bddc034e063</entry>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="uuid">2355fe9d-511a-4e7c-ac2a-5bddc034e063</entry>
Apr 13 22:53:20 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:20 user nova-compute[71269]:     </system>
Apr 13 22:53:20 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:20 user nova-compute[71269]:   <os>
Apr 13 22:53:20 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:20 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:20 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:20 user nova-compute[71269]:   </os>
Apr 13 22:53:20 user nova-compute[71269]:   <features>
Apr 13 22:53:20 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:20 user nova-compute[71269]:     <apic/>
Apr 13 22:53:20 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:20 user nova-compute[71269]:   </features>
Apr 13 22:53:20 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:20 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:20 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:20 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:20 user nova-compute[71269]:   </clock>
Apr 13 22:53:20 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:20 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:20 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:20 user nova-compute[71269]:   </cpu>
Apr 13 22:53:20 user nova-compute[71269]:   <devices>
Apr 13 22:53:20 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:20 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:20 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk"/>
Apr 13 22:53:20 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:20 user nova-compute[71269]:     </disk>
Apr 13 22:53:20 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:20 user nova-compute[71269]:       <mac address="fa:16:3e:bc:7d:a6"/>
Apr 13 22:53:20 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:20 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:20 user nova-compute[71269]:       <target dev="tap3958622e-6a"/>
Apr 13 22:53:20 user nova-compute[71269]:     </interface>
Apr 13 22:53:20 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:20 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/console.log" append="off"/>
Apr 13 22:53:20 user nova-compute[71269]:     </serial>
Apr 13 22:53:20 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:20 user nova-compute[71269]:     <video>
Apr 13 22:53:20 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:20 user nova-compute[71269]:     </video>
Apr 13 22:53:20 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:20 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:20 user nova-compute[71269]:     </rng>
Apr 13 22:53:20 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:20 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:20 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:20 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:20 user nova-compute[71269]:   </devices>
Apr 13 22:53:20 user nova-compute[71269]: </domain>
Apr 13 22:53:20 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1789468832',display_name='tempest-VolumesAdminNegativeTest-server-1789468832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1789468832',id=7,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObF04qfQe1XUBpXGnJngmDi1GmEIreN0d0ZxA7hkpzFUTJv86Fr4EfbN4NCxkHRaIN2RUxi8ku3mcOnyyqemReBiK8NwWityhFwwbgBqfpTW9dedeBA81mDCVtDqQo2+A==',key_name='tempest-keypair-686921666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-kn3txfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=2355fe9d-511a-4e7c-ac2a-5bddc034e063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG os_vif [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3958622e-6a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3958622e-6a, col_values=(('external_ids', {'iface-id': '3958622e-6a70-4931-b630-26e0a53c5755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:7d:a6', 'vm-uuid': '2355fe9d-511a-4e7c-ac2a-5bddc034e063'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:20 user nova-compute[71269]: INFO os_vif [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a')
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720.converted --force-share --output=json" returned: 0 in 0.274s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "7455f69690b09a411abe9b4f7fd395cf182c3720" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.618s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No VIF found with MAC fa:16:3e:bc:7d:a6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json" returned: 0 in 0.213s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "7455f69690b09a411abe9b4f7fd395cf182c3720" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "7455f69690b09a411abe9b4f7fd395cf182c3720" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json" returned: 0 in 0.269s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720,backing_fmt=raw /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Successfully created port: 444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720,backing_fmt=raw /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk 1073741824" returned: 0 in 0.083s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "7455f69690b09a411abe9b4f7fd395cf182c3720" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720 --force-share --output=json" returned: 0 in 0.283s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Cannot resize image /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'migration_context' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Ensure instance console log exists: /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updated VIF entry in instance network info cache for port 3958622e-6a70-4931-b630-26e0a53c5755. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating instance_info_cache with network_info: [{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fdec2ef1-a8c6-460b-b8fc-b0b3579587ea req-fbaae06f-e472-4853-8b47-2ec2b81d51fb service nova] Releasing lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Successfully updated port: 444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-changed-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Refreshing instance network info cache due to event network-changed-444b360c-4e8d-4075-a10a-dca6e73083b0. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Acquiring lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Acquired lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Refreshing network info cache for port 444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18ea2071-3125-4d2c-bf32-dc2c64069e26 req-cdb7542b-7f53-49f5-9675-0fcf494d6182 service nova] Releasing lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquired lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updating instance_info_cache with network_info: [{"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Releasing lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance network_info: |[{"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Start _get_guest_xml network_info=[{"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:53:05Z,direct_url=<?>,disk_format='qcow2',id=23f6496f-7550-41f3-a9ce-a6e787316117,min_disk=0,min_ram=0,name='',owner='0e40985149d64bb8aa55cd05a616b2ea',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:53:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/sda', 'guest_format': None, 'device_type': 'disk', 'image_id': '23f6496f-7550-41f3-a9ce-a6e787316117'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:24 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:24 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:53:05Z,direct_url=<?>,disk_format='qcow2',id=23f6496f-7550-41f3-a9ce-a6e787316117,min_disk=0,min_ram=0,name='',owner='0e40985149d64bb8aa55cd05a616b2ea',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:53:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1988745821',display_name='tempest-AttachSCSIVolumeTestJSON-server-1988745821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1988745821',id=8,image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXj02oyoksF1tjWwSgW0skVN3juez2TfkFa4tY4tvPDRSVTwcYPTRDAeB0p5mOsILnlocO3X8FdWawd/NGV/BrUcM9pknOVivGHz3Nhsk+gPH86ILA1HHLQ+H7QpdJ33A==',key_name='tempest-keypair-864897906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc753ebae6474a4b8a914b240795df82',ramdisk_id='',reservation_id='r-m7bt1u9w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-791951707',owner_user_name='tempest-AttachSCSIVolumeTestJSON-791951707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d624ba67e327453881558410a112910a',uuid=b8400cd0-5a21-4ca5-a4b6-1683897941ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converting VIF {"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'pci_devices' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:24 user nova-compute[71269]:   <uuid>b8400cd0-5a21-4ca5-a4b6-1683897941ab</uuid>
Apr 13 22:53:24 user nova-compute[71269]:   <name>instance-00000008</name>
Apr 13 22:53:24 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:24 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:24 user nova-compute[71269]:   <metadata>
Apr 13 22:53:24 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:24 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1988745821</nova:name>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:24</nova:creationTime>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:24 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:24 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:user uuid="d624ba67e327453881558410a112910a">tempest-AttachSCSIVolumeTestJSON-791951707-project-member</nova:user>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:project uuid="cc753ebae6474a4b8a914b240795df82">tempest-AttachSCSIVolumeTestJSON-791951707</nova:project>
Apr 13 22:53:24 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:root type="image" uuid="23f6496f-7550-41f3-a9ce-a6e787316117"/>
Apr 13 22:53:24 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:24 user nova-compute[71269]:         <nova:port uuid="444b360c-4e8d-4075-a10a-dca6e73083b0">
Apr 13 22:53:24 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:53:24 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:24 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:24 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:24 user nova-compute[71269]:   </metadata>
Apr 13 22:53:24 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:24 user nova-compute[71269]:     <system>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="serial">b8400cd0-5a21-4ca5-a4b6-1683897941ab</entry>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="uuid">b8400cd0-5a21-4ca5-a4b6-1683897941ab</entry>
Apr 13 22:53:24 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:24 user nova-compute[71269]:     </system>
Apr 13 22:53:24 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:24 user nova-compute[71269]:   <os>
Apr 13 22:53:24 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:24 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:24 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:24 user nova-compute[71269]:   </os>
Apr 13 22:53:24 user nova-compute[71269]:   <features>
Apr 13 22:53:24 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:24 user nova-compute[71269]:     <apic/>
Apr 13 22:53:24 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:24 user nova-compute[71269]:   </features>
Apr 13 22:53:24 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:24 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:24 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:24 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:24 user nova-compute[71269]:   </clock>
Apr 13 22:53:24 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:24 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:24 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:24 user nova-compute[71269]:   </cpu>
Apr 13 22:53:24 user nova-compute[71269]:   <devices>
Apr 13 22:53:24 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:24 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:24 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk"/>
Apr 13 22:53:24 user nova-compute[71269]:       <target dev="sda" bus="scsi"/>
Apr 13 22:53:24 user nova-compute[71269]:       <address type="drive" controller="0" unit="0"/>
Apr 13 22:53:24 user nova-compute[71269]:     </disk>
Apr 13 22:53:24 user nova-compute[71269]:     <disk type="file" device="cdrom">
Apr 13 22:53:24 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 22:53:24 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.config"/>
Apr 13 22:53:24 user nova-compute[71269]:       <target dev="sdb" bus="scsi"/>
Apr 13 22:53:24 user nova-compute[71269]:       <address type="drive" controller="0" unit="1"/>
Apr 13 22:53:24 user nova-compute[71269]:     </disk>
Apr 13 22:53:24 user nova-compute[71269]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 22:53:24 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:24 user nova-compute[71269]:       <mac address="fa:16:3e:aa:18:0f"/>
Apr 13 22:53:24 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:24 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:24 user nova-compute[71269]:       <target dev="tap444b360c-4e"/>
Apr 13 22:53:24 user nova-compute[71269]:     </interface>
Apr 13 22:53:24 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:24 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/console.log" append="off"/>
Apr 13 22:53:24 user nova-compute[71269]:     </serial>
Apr 13 22:53:24 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:24 user nova-compute[71269]:     <video>
Apr 13 22:53:24 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:24 user nova-compute[71269]:     </video>
Apr 13 22:53:24 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:24 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:24 user nova-compute[71269]:     </rng>
Apr 13 22:53:24 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:24 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:24 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:24 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:24 user nova-compute[71269]:   </devices>
Apr 13 22:53:24 user nova-compute[71269]: </domain>
Apr 13 22:53:24 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1988745821',display_name='tempest-AttachSCSIVolumeTestJSON-server-1988745821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1988745821',id=8,image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXj02oyoksF1tjWwSgW0skVN3juez2TfkFa4tY4tvPDRSVTwcYPTRDAeB0p5mOsILnlocO3X8FdWawd/NGV/BrUcM9pknOVivGHz3Nhsk+gPH86ILA1HHLQ+H7QpdJ33A==',key_name='tempest-keypair-864897906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc753ebae6474a4b8a914b240795df82',ramdisk_id='',reservation_id='r-m7bt1u9w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-791951707',owner_user_name='tempest-AttachSCSIVolumeTestJSON-791951707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d624ba67e327453881558410a112910a',uuid=b8400cd0-5a21-4ca5-a4b6-1683897941ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converting VIF {"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG os_vif [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap444b360c-4e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap444b360c-4e, col_values=(('external_ids', {'iface-id': '444b360c-4e8d-4075-a10a-dca6e73083b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:18:0f', 'vm-uuid': 'b8400cd0-5a21-4ca5-a4b6-1683897941ab'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:24 user nova-compute[71269]: INFO os_vif [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e')
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] No waiting events found dispatching network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:24 user nova-compute[71269]: WARNING nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received unexpected event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 for instance with vm_state building and task_state spawning.
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] No waiting events found dispatching network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:24 user nova-compute[71269]: WARNING nova.compute.manager [req-709feaa0-fa57-490c-8e33-d0bc13f7c3fd req-fd224e26-dd43-49c7-bbf7-456c79a201d1 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received unexpected event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 for instance with vm_state building and task_state spawning.
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No BDM found with device name sda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No VIF found with MAC fa:16:3e:aa:18:0f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Using config drive
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Creating config drive at /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.config
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnlug1640 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnlug1640" returned: 0 in 0.068s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.claims [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Claim successful on node user
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426405.5903084, 2355fe9d-511a-4e7c-ac2a-5bddc034e063 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] VM Resumed (Lifecycle Event)
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Instance spawned successfully.
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426405.5906947, 2355fe9d-511a-4e7c-ac2a-5bddc034e063 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] VM Started (Lifecycle Event)
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Took 9.66 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:25 user nova-compute[71269]: INFO nova.compute.manager [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Took 11.19 seconds to build instance.
Apr 13 22:53:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36bb7d37-3bed-4f7e-bcad-8960fdc2458a tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.326s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:53:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.policy [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20751f66f6564d04807dc09a675aef70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f871045289a43d18b339d3dac4d0666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:53:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Creating image(s)
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "/opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "/opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.284s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.283s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk 1073741824" returned: 0 in 0.101s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] No waiting events found dispatching network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:27 user nova-compute[71269]: WARNING nova.compute.manager [req-7c744429-8994-4ddb-bf5d-427466f72a33 req-fc15f035-1980-4b0f-8f8e-9ceb54065cc8 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received unexpected event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 for instance with vm_state building and task_state spawning.
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.356s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Successfully created port: 603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Cannot resize image /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'migration_context' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Ensure instance console log exists: /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Successfully updated port: 603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquired lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-changed-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Refreshing instance network info cache due to event network-changed-603de7bb-7bac-4b93-b74f-d51fb87ffe46. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Acquiring lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating instance_info_cache with network_info: [{"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] No waiting events found dispatching network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:29 user nova-compute[71269]: WARNING nova.compute.manager [req-7bcea8b6-3bd0-4031-963f-668f4f524fef req-a45099a0-3c41-485f-945d-933c56f21f80 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received unexpected event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 for instance with vm_state building and task_state spawning.
Apr 13 22:53:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Releasing lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Instance network_info: |[{"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Acquired lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Refreshing network info cache for port 603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Start _get_guest_xml network_info=[{"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:53:29 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:29 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-519422002',display_name='tempest-TestVolumeSwap-server-519422002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-519422002',id=9,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/rpH+TiQwOSAqxTgoxwVRyx6Xsj2Nna6t2S66aajDjD8Allx8sB6ScX+MnwX9OU0lN861st5YAbEYWblv9K5uoyp9FWTta6tO5LPbohE9CGSW6ew7DKfx9QVGP5Xsfcw==',key_name='tempest-keypair-2139033731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f871045289a43d18b339d3dac4d0666',ramdisk_id='',reservation_id='r-b1jom9ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1308560563',owner_user_name='tempest-TestVolumeSwap-1308560563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20751f66f6564d04807dc09a675aef70',uuid=3d246d08-7efe-4307-8a37-32f4c0621128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converting VIF {"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:53:29 user nova-compute[71269]:   <uuid>3d246d08-7efe-4307-8a37-32f4c0621128</uuid>
Apr 13 22:53:29 user nova-compute[71269]:   <name>instance-00000009</name>
Apr 13 22:53:29 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:53:29 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:53:29 user nova-compute[71269]:   <metadata>
Apr 13 22:53:29 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:53:29 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:name>tempest-TestVolumeSwap-server-519422002</nova:name>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:53:29</nova:creationTime>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:53:29 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:53:29 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:owner>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:user uuid="20751f66f6564d04807dc09a675aef70">tempest-TestVolumeSwap-1308560563-project-member</nova:user>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:project uuid="3f871045289a43d18b339d3dac4d0666">tempest-TestVolumeSwap-1308560563</nova:project>
Apr 13 22:53:29 user nova-compute[71269]:       </nova:owner>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:53:29 user nova-compute[71269]:       <nova:ports>
Apr 13 22:53:29 user nova-compute[71269]:         <nova:port uuid="603de7bb-7bac-4b93-b74f-d51fb87ffe46">
Apr 13 22:53:29 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 22:53:29 user nova-compute[71269]:         </nova:port>
Apr 13 22:53:29 user nova-compute[71269]:       </nova:ports>
Apr 13 22:53:29 user nova-compute[71269]:     </nova:instance>
Apr 13 22:53:29 user nova-compute[71269]:   </metadata>
Apr 13 22:53:29 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:53:29 user nova-compute[71269]:     <system>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="serial">3d246d08-7efe-4307-8a37-32f4c0621128</entry>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="uuid">3d246d08-7efe-4307-8a37-32f4c0621128</entry>
Apr 13 22:53:29 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:53:29 user nova-compute[71269]:     </system>
Apr 13 22:53:29 user nova-compute[71269]:   </sysinfo>
Apr 13 22:53:29 user nova-compute[71269]:   <os>
Apr 13 22:53:29 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:53:29 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:53:29 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:53:29 user nova-compute[71269]:   </os>
Apr 13 22:53:29 user nova-compute[71269]:   <features>
Apr 13 22:53:29 user nova-compute[71269]:     <acpi/>
Apr 13 22:53:29 user nova-compute[71269]:     <apic/>
Apr 13 22:53:29 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:53:29 user nova-compute[71269]:   </features>
Apr 13 22:53:29 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:53:29 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:53:29 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:53:29 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:53:29 user nova-compute[71269]:   </clock>
Apr 13 22:53:29 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:53:29 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:53:29 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:53:29 user nova-compute[71269]:   </cpu>
Apr 13 22:53:29 user nova-compute[71269]:   <devices>
Apr 13 22:53:29 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:53:29 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:53:29 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk"/>
Apr 13 22:53:29 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:53:29 user nova-compute[71269]:     </disk>
Apr 13 22:53:29 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:53:29 user nova-compute[71269]:       <mac address="fa:16:3e:e6:45:59"/>
Apr 13 22:53:29 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:29 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:53:29 user nova-compute[71269]:       <target dev="tap603de7bb-7b"/>
Apr 13 22:53:29 user nova-compute[71269]:     </interface>
Apr 13 22:53:29 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:53:29 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/console.log" append="off"/>
Apr 13 22:53:29 user nova-compute[71269]:     </serial>
Apr 13 22:53:29 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:53:29 user nova-compute[71269]:     <video>
Apr 13 22:53:29 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:53:29 user nova-compute[71269]:     </video>
Apr 13 22:53:29 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:53:29 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:53:29 user nova-compute[71269]:     </rng>
Apr 13 22:53:29 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:53:29 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:53:29 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:53:29 user nova-compute[71269]:     </memballoon>
Apr 13 22:53:29 user nova-compute[71269]:   </devices>
Apr 13 22:53:29 user nova-compute[71269]: </domain>
Apr 13 22:53:29 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-519422002',display_name='tempest-TestVolumeSwap-server-519422002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-519422002',id=9,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/rpH+TiQwOSAqxTgoxwVRyx6Xsj2Nna6t2S66aajDjD8Allx8sB6ScX+MnwX9OU0lN861st5YAbEYWblv9K5uoyp9FWTta6tO5LPbohE9CGSW6ew7DKfx9QVGP5Xsfcw==',key_name='tempest-keypair-2139033731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f871045289a43d18b339d3dac4d0666',ramdisk_id='',reservation_id='r-b1jom9ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1308560563',owner_user_name='tempest-TestVolumeSwap-1308560563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20751f66f6564d04807dc09a675aef70',uuid=3d246d08-7efe-4307-8a37-32f4c0621128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converting VIF {"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG os_vif [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap603de7bb-7b, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap603de7bb-7b, col_values=(('external_ids', {'iface-id': '603de7bb-7bac-4b93-b74f-d51fb87ffe46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:45:59', 'vm-uuid': '3d246d08-7efe-4307-8a37-32f4c0621128'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:29 user nova-compute[71269]: INFO os_vif [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b')
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] No VIF found with MAC fa:16:3e:e6:45:59, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426409.909223, b8400cd0-5a21-4ca5-a4b6-1683897941ab => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] VM Resumed (Lifecycle Event)
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance spawned successfully.
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426409.9158204, b8400cd0-5a21-4ca5-a4b6-1683897941ab => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] VM Started (Lifecycle Event)
Apr 13 22:53:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:30 user nova-compute[71269]: INFO nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Took 11.11 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:30 user nova-compute[71269]: INFO nova.compute.manager [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Took 12.82 seconds to build instance.
Apr 13 22:53:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d350670c-2b97-4a89-93d9-a427b4f50b28 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.031s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updated VIF entry in instance network info cache for port 603de7bb-7bac-4b93-b74f-d51fb87ffe46. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:53:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating instance_info_cache with network_info: [{"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f76417d9-590d-47e5-adb4-909b733e2dea req-ccfcd7ec-6dad-4b7e-baea-62f39f98c14d service nova] Releasing lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] No waiting events found dispatching network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:32 user nova-compute[71269]: WARNING nova.compute.manager [req-a83fd427-9188-4a31-9ed6-c7ac1fcb391c req-13d03264-1577-4cbd-81e9-4eb08bd9a10b service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received unexpected event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance with vm_state building and task_state spawning.
Apr 13 22:53:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:53:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] No waiting events found dispatching network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:53:34 user nova-compute[71269]: WARNING nova.compute.manager [req-b6ce543c-7900-47cc-901d-fa85458e3825 req-98c0b962-e17f-4220-8e5a-a206cc7d7e54 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received unexpected event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance with vm_state building and task_state spawning.
Apr 13 22:53:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426415.032318, 3d246d08-7efe-4307-8a37-32f4c0621128 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] VM Resumed (Lifecycle Event)
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Instance spawned successfully.
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426415.0367966, 3d246d08-7efe-4307-8a37-32f4c0621128 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] VM Started (Lifecycle Event)
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Took 8.65 seconds to spawn the instance on the hypervisor.
Apr 13 22:53:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:53:35 user nova-compute[71269]: INFO nova.compute.manager [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Took 9.92 seconds to build instance.
Apr 13 22:53:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0c1e6f0-94f3-42f3-82e8-adead408da05 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.244s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:53:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:40 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:53:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:45 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:45 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=26.639209747314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3d246d08-7efe-4307-8a37-32f4c0621128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:53:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:53:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:53:46 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:53:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:53:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:53:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:53:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:53:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:54:11 user nova-compute[71269]: INFO nova.compute.claims [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Claim successful on node user
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:54:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:54:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:54:12 user nova-compute[71269]: INFO nova.virt.block_device [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Booting with volume snapshot 364674b2-460b-4c60-a0c0-e39820135f5b at /dev/vda
Apr 13 22:54:12 user nova-compute[71269]: DEBUG nova.policy [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:54:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Successfully created port: 919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Successfully updated port: 919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-changed-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Refreshing instance network info cache due to event network-changed-919802cc-1446-473e-8f73-b2f8a10750ee. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Acquiring lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updating instance_info_cache with network_info: [{"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Instance network_info: |[{"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Acquired lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Refreshing network info cache for port 919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:54:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updated VIF entry in instance network info cache for port 919802cc-1446-473e-8f73-b2f8a10750ee. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:54:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updating instance_info_cache with network_info: [{"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3c5d0e0-0fbf-4733-a21d-4e7ad3c81207 req-17b13f14-8b68-491d-870d-4793aab0cac0 service nova] Releasing lock "refresh_cache-4a0a6479-bc85-4617-8225-d8169dfb2c8d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:18 user nova-compute[71269]: DEBUG os_brick.utils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:18 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpbrr1jh2h/privsep.sock']
Apr 13 22:54:18 user sudo[81823]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpbrr1jh2h/privsep.sock
Apr 13 22:54:18 user sudo[81823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 22:54:20 user sudo[81823]: pam_unix(sudo:session): session closed for user root
Apr 13 22:54:20 user nova-compute[71269]: INFO oslo.privsep.daemon [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Spawned new privsep daemon via rootwrap
Apr 13 22:54:20 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 22:54:20 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 22:54:20 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 22:54:20 user nova-compute[71269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81834
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7522c9-859f-426c-be1c-68cc029b096f]: (2,) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4df2db-689d-4a3a-886a-5407fcc575c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: WARNING os_brick.initiator.connectors.nvmeof [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a899a7d-4cc5-486a-986a-62ced167268e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50950f8-aa82-4e0f-8eb4-953cf271d856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f96bf-5b18-43a1-ad3a-d1f461a48e92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:20 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:54:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c93799-1907-4eda-9913-ab1b3bd351a3]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG os_brick.utils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (2044ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:20 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updating existing volume attachment record: 1e9b8caf-0a48-4c4a-af11-639ceb936d4e {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:54:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Creating image(s)
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/4a0a6479-bc85-4617-8225-d8169dfb2c8d/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Start _get_guest_xml network_info=[{"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '1e9b8caf-0a48-4c4a-af11-639ceb936d4e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFgmsSbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a0a6479-bc85-4617-8225-d8169dfb2c8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc33cc39-2831-4966-ac69-82b1b4c77c40', 'serial': 'fc33cc39-2831-4966-ac69-82b1b4c77c40'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:54:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connector [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Factory for ISCSI on None {{(pid=71269) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFgmsSbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:25 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0186834-d42b-4690-bae9-d015e80ed7fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:54:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f23d2-ce01-4e0b-a30a-b6f9ec6e54ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40] added
Apr 13 22:54:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc44105-b89a-4ffc-b7dc-bb6bf53cb287]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9932c75-6e3c-4966-982b-d4bff6941e4e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFgmsSbd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFgmsSbd" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf30e9-76f5-459f-b07a-3bbb9d74bb72]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tFgmsSbd'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f31ed-76be-4771-9ab7-3192704a016a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e94f65-1c5c-435c-8b16-786a8f9609d1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:54:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 22:54:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 22:54:25 user nova-compute[71269]: 
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5321f41-63d4-41a5-a9d4-ea07b6256128]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260]
Apr 13 22:54:25 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260] successful.
Apr 13 22:54:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab66b6-0527-4981-b8b0-e4281ddb53db]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f29d2-759f-494b-b747-10427f67d21d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f56f42-a0de-4c65-b326-8021ca876a2a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFgmsSbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:54:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23564363461313832', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564363461313832', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409547542',display_name='tempest-TestVolumeBootPattern-server-1409547542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409547542',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-j1jsvwj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:54:12Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=4a0a6479-bc85-4617-8225-d8169dfb2c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a0a6479-bc85-4617-8225-d8169dfb2c8d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:54:26 user nova-compute[71269]:   <uuid>4a0a6479-bc85-4617-8225-d8169dfb2c8d</uuid>
Apr 13 22:54:26 user nova-compute[71269]:   <name>instance-0000000a</name>
Apr 13 22:54:26 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:54:26 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:54:26 user nova-compute[71269]:   <metadata>
Apr 13 22:54:26 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:54:26 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:54:26 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-server-1409547542</nova:name>
Apr 13 22:54:26 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:54:25</nova:creationTime>
Apr 13 22:54:26 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:54:26 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:54:26 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:54:26 user nova-compute[71269]:       <nova:owner>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 22:54:26 user nova-compute[71269]:       </nova:owner>
Apr 13 22:54:26 user nova-compute[71269]:       <nova:ports>
Apr 13 22:54:26 user nova-compute[71269]:         <nova:port uuid="919802cc-1446-473e-8f73-b2f8a10750ee">
Apr 13 22:54:26 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 22:54:26 user nova-compute[71269]:         </nova:port>
Apr 13 22:54:26 user nova-compute[71269]:       </nova:ports>
Apr 13 22:54:26 user nova-compute[71269]:     </nova:instance>
Apr 13 22:54:26 user nova-compute[71269]:   </metadata>
Apr 13 22:54:26 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:54:26 user nova-compute[71269]:     <system>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="serial">4a0a6479-bc85-4617-8225-d8169dfb2c8d</entry>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="uuid">4a0a6479-bc85-4617-8225-d8169dfb2c8d</entry>
Apr 13 22:54:26 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:54:26 user nova-compute[71269]:     </system>
Apr 13 22:54:26 user nova-compute[71269]:   </sysinfo>
Apr 13 22:54:26 user nova-compute[71269]:   <os>
Apr 13 22:54:26 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:54:26 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:54:26 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:54:26 user nova-compute[71269]:   </os>
Apr 13 22:54:26 user nova-compute[71269]:   <features>
Apr 13 22:54:26 user nova-compute[71269]:     <acpi/>
Apr 13 22:54:26 user nova-compute[71269]:     <apic/>
Apr 13 22:54:26 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:54:26 user nova-compute[71269]:   </features>
Apr 13 22:54:26 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:54:26 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:54:26 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:54:26 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:54:26 user nova-compute[71269]:   </clock>
Apr 13 22:54:26 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:54:26 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:54:26 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:54:26 user nova-compute[71269]:   </cpu>
Apr 13 22:54:26 user nova-compute[71269]:   <devices>
Apr 13 22:54:26 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:54:26 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:54:26 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 22:54:26 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:54:26 user nova-compute[71269]:       <serial>fc33cc39-2831-4966-ac69-82b1b4c77c40</serial>
Apr 13 22:54:26 user nova-compute[71269]:     </disk>
Apr 13 22:54:26 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:54:26 user nova-compute[71269]:       <mac address="fa:16:3e:00:68:11"/>
Apr 13 22:54:26 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:54:26 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:54:26 user nova-compute[71269]:       <target dev="tap919802cc-14"/>
Apr 13 22:54:26 user nova-compute[71269]:     </interface>
Apr 13 22:54:26 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:54:26 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/4a0a6479-bc85-4617-8225-d8169dfb2c8d/console.log" append="off"/>
Apr 13 22:54:26 user nova-compute[71269]:     </serial>
Apr 13 22:54:26 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:54:26 user nova-compute[71269]:     <video>
Apr 13 22:54:26 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:54:26 user nova-compute[71269]:     </video>
Apr 13 22:54:26 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:54:26 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:54:26 user nova-compute[71269]:     </rng>
Apr 13 22:54:26 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:54:26 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:54:26 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:54:26 user nova-compute[71269]:     </memballoon>
Apr 13 22:54:26 user nova-compute[71269]:   </devices>
Apr 13 22:54:26 user nova-compute[71269]: </domain>
Apr 13 22:54:26 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409547542',display_name='tempest-TestVolumeBootPattern-server-1409547542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409547542',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-j1jsvwj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:54:12Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=4a0a6479-bc85-4617-8225-d8169dfb2c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG os_vif [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap919802cc-14, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap919802cc-14, col_values=(('external_ids', {'iface-id': '919802cc-1446-473e-8f73-b2f8a10750ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:68:11', 'vm-uuid': '4a0a6479-bc85-4617-8225-d8169dfb2c8d'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:26 user nova-compute[71269]: INFO os_vif [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14')
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:00:68:11, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:54:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] No waiting events found dispatching network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:28 user nova-compute[71269]: WARNING nova.compute.manager [req-0670f3ae-f0c9-415d-a7db-7d237b3a7fa5 req-c40c81d4-54ee-48a4-a473-6549ef12784e service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received unexpected event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee for instance with vm_state building and task_state spawning.
Apr 13 22:54:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426469.991844, 4a0a6479-bc85-4617-8225-d8169dfb2c8d => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:54:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] VM Resumed (Lifecycle Event)
Apr 13 22:54:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:54:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Instance spawned successfully.
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426469.9937475, 4a0a6479-bc85-4617-8225-d8169dfb2c8d => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] VM Started (Lifecycle Event)
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] No waiting events found dispatching network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:30 user nova-compute[71269]: WARNING nova.compute.manager [req-46c7dfe0-624d-4641-893d-f22ce920f9b6 req-f1664f6d-ce83-4e29-bd57-5b678eeb85fa service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received unexpected event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee for instance with vm_state building and task_state spawning.
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Took 5.12 seconds to spawn the instance on the hypervisor.
Apr 13 22:54:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:30 user nova-compute[71269]: INFO nova.compute.manager [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Took 18.76 seconds to build instance.
Apr 13 22:54:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-95db6eea-98dd-4929-b41c-e82724647c3b tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.876s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing instance network info cache due to event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:54:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:54:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updated VIF entry in instance network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:54:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-544f17b3-8ed4-451b-857f-73cc1308d8c6 req-88958e91-74ae-4306-94e5-a02b0825402b service nova] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:37 user nova-compute[71269]: INFO nova.compute.manager [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] instance snapshotting
Apr 13 22:54:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Beginning live snapshot process
Apr 13 22:54:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f.delta 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f.delta 1073741824" returned: 0 in 0.051s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 22:54:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71269) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 22:54:38 user nova-compute[71269]: INFO nova.virt.libvirt.host [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] UEFI support detected
Apr 13 22:54:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:54:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:54:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 22:54:39 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:54:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f.delta /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f.delta /opt/stack/data/nova/instances/snapshots/tmp0ub1i4_w/c59cb6a142bf477aaf77dfcd17a8010f" returned: 0 in 0.486s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Snapshot extracted, beginning image upload
Apr 13 22:54:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:41 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Snapshot image upload complete
Apr 13 22:54:42 user nova-compute[71269]: INFO nova.compute.manager [None req-89523c6f-e6fe-445d-a35c-7b40776edb68 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Took 5.08 seconds to snapshot the instance on the hypervisor.
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:42 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:54:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG nova.objects.instance [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lazy-loading 'flavor' on Instance uuid 636a69ed-f9b3-4b91-b371-7f7bf3e85154 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:45 user nova-compute[71269]: INFO nova.compute.manager [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Attaching volume 6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 to /dev/vdb
Apr 13 22:54:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.utils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=26.546764373779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[06152a94-fe42-4513-812f-f5badad6a77d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bdb08-ca09-4aba-a599-5404e4e54b11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8753d3d-62d1-4683-b183-bd8fe57e528c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc46d3-6511-4927-8bcf-fb926422f015]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:46 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:54:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f17b41-9ce7-4a2c-87c7-73a6a99b9b81]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG os_brick.utils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] <== get_connector_properties: return (294ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updating existing volume attachment record: e3bc5409-8b66-46f1-be86-1047f1704b36 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3d246d08-7efe-4307-8a37-32f4c0621128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b8400cd0-5a21-4ca5-a4b6-1683897941ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:54:46 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:54:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:54:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updating instance_info_cache with network_info: [{"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-636a69ed-f9b3-4b91-b371-7f7bf3e85154" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-changed-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Refreshing instance network info cache due to event network-changed-94c47f47-2ee7-46d0-858d-a5ff3270a80b. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:48 user nova-compute[71269]: DEBUG nova.network.neutron [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Refreshing network info cache for port 94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:54:49 user nova-compute[71269]: DEBUG nova.network.neutron [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updated VIF entry in instance network info cache for port 94c47f47-2ee7-46d0-858d-a5ff3270a80b. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:54:49 user nova-compute[71269]: DEBUG nova.network.neutron [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-854a5964-35bb-482a-8318-0708d27a3f70 req-220f1b19-1dcf-49c1-80bb-2062f27da7e3 service nova] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:49 user nova-compute[71269]: INFO nova.compute.manager [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Rescuing
Apr 13 22:54:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:49 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:50 user nova-compute[71269]: WARNING nova.compute.manager [req-18f3606e-b082-4f49-9fff-9d0e027dc176 req-300bc18f-1edb-41d5-987d-e0242a3f2bc2 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state active and task_state rescuing.
Apr 13 22:54:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG nova.objects.instance [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:51 user nova-compute[71269]: INFO nova.compute.manager [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Attaching volume a58090c7-ce32-4a3f-a2f0-f327259775e7 to /dev/vdb
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPevnXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:51 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance destroyed successfully.
Apr 13 22:54:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Attempting rescue
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a2fa2-ac8c-4b99-aa94-a5887e0f827f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:54:51 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.utils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 22:54:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Creating image(s)
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'trusted_certs' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf44304-743e-4e23-b3da-dce73e201056]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[33850a0f-27a8-4ca3-8c22-b9efc3108038]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52] added
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3685da-9386-4db7-8a2c-c1648773c117]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c33b77-bebd-4fd0-9927-00564660f28a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa8f3a-8d7d-4191-9bc0-369de63f54c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c221a4d9-d277-43dd-9ab9-7d7bcc1812b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ce80f-4af7-4439-a1a3-37a81a5416dc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPevnXsN {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:51 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ee371-f9c5-4e8d-a89f-535872b3924d]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.utils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating existing volume attachment record: 3c2fe143-1ebf-4424-a954-47c5482950f5 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPevnXsN" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[131161cc-35a7-4af2-84c5-b184e964908f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPevnXsN'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4de57-53b6-4467-89c5-fa1efbd3410a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb20efd-890a-44c1-87c2-a553e5b7e23b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start _get_guest_xml network_info=[{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:ae:e2:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'numa_topology' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce25657-23a4-4f5c-b4ce-1f0629512c86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260]
Apr 13 22:54:51 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260] successful.
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1927376719',display_name='tempest-ServerRescueNegativeTestJSON-server-1927376719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1927376719',id=5,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-jsn1bir9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:17Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=ff417f05-3cfa-4274-a0d9-9145ce1e5f83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:ae:e2:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:ae:e2:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58cf46-443a-4e77-a1cf-962ba48dcb54]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:54:51 user nova-compute[71269]:   <uuid>ff417f05-3cfa-4274-a0d9-9145ce1e5f83</uuid>
Apr 13 22:54:51 user nova-compute[71269]:   <name>instance-00000005</name>
Apr 13 22:54:51 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:54:51 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:54:51 user nova-compute[71269]:   <metadata>
Apr 13 22:54:51 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:54:51 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1927376719</nova:name>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:54:51</nova:creationTime>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:54:51 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:54:51 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:owner>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 22:54:51 user nova-compute[71269]:       </nova:owner>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:54:51 user nova-compute[71269]:       <nova:ports>
Apr 13 22:54:51 user nova-compute[71269]:         <nova:port uuid="ac600f3d-8b2c-4200-81dd-3d35843d3f28">
Apr 13 22:54:51 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 22:54:51 user nova-compute[71269]:         </nova:port>
Apr 13 22:54:51 user nova-compute[71269]:       </nova:ports>
Apr 13 22:54:51 user nova-compute[71269]:     </nova:instance>
Apr 13 22:54:51 user nova-compute[71269]:   </metadata>
Apr 13 22:54:51 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:54:51 user nova-compute[71269]:     <system>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="serial">ff417f05-3cfa-4274-a0d9-9145ce1e5f83</entry>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="uuid">ff417f05-3cfa-4274-a0d9-9145ce1e5f83</entry>
Apr 13 22:54:51 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:54:51 user nova-compute[71269]:     </system>
Apr 13 22:54:51 user nova-compute[71269]:   </sysinfo>
Apr 13 22:54:51 user nova-compute[71269]:   <os>
Apr 13 22:54:51 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:54:51 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:54:51 user nova-compute[71269]:   </os>
Apr 13 22:54:51 user nova-compute[71269]:   <features>
Apr 13 22:54:51 user nova-compute[71269]:     <acpi/>
Apr 13 22:54:51 user nova-compute[71269]:     <apic/>
Apr 13 22:54:51 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:54:51 user nova-compute[71269]:   </features>
Apr 13 22:54:51 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:54:51 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:54:51 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:54:51 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:54:51 user nova-compute[71269]:   </clock>
Apr 13 22:54:51 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:54:51 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:54:51 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:54:51 user nova-compute[71269]:   </cpu>
Apr 13 22:54:51 user nova-compute[71269]:   <devices>
Apr 13 22:54:51 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:54:51 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:54:51 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue"/>
Apr 13 22:54:51 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:54:51 user nova-compute[71269]:     </disk>
Apr 13 22:54:51 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:54:51 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:54:51 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk"/>
Apr 13 22:54:51 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:54:51 user nova-compute[71269]:     </disk>
Apr 13 22:54:51 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:54:51 user nova-compute[71269]:       <mac address="fa:16:3e:ae:e2:b2"/>
Apr 13 22:54:51 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:54:51 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:54:51 user nova-compute[71269]:       <target dev="tapac600f3d-8b"/>
Apr 13 22:54:51 user nova-compute[71269]:     </interface>
Apr 13 22:54:51 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:54:51 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/console.log" append="off"/>
Apr 13 22:54:51 user nova-compute[71269]:     </serial>
Apr 13 22:54:51 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:54:51 user nova-compute[71269]:     <video>
Apr 13 22:54:51 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:54:51 user nova-compute[71269]:     </video>
Apr 13 22:54:51 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:54:51 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:54:51 user nova-compute[71269]:     </rng>
Apr 13 22:54:51 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:54:51 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:54:51 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:54:51 user nova-compute[71269]:     </memballoon>
Apr 13 22:54:51 user nova-compute[71269]:   </devices>
Apr 13 22:54:51 user nova-compute[71269]: </domain>
Apr 13 22:54:51 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:54:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance destroyed successfully.
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef318ae0-83ca-43f6-8b8a-1117f207ac39]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)
Apr 13 22:54:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9f2b4-4148-49da-a043-b0e25969e634]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPevnXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:ae:e2:b2, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-changed-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Refreshing instance network info cache due to event network-changed-822bdb49-5f9a-4949-8543-929b1764e810. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Acquiring lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Acquired lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Refreshing network info cache for port 822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '26162363864343537', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162363864343537', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.objects.instance [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lazy-loading 'flavor' on Instance uuid 636a69ed-f9b3-4b91-b371-7f7bf3e85154 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:54:52 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:54:52 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 22:54:52 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:54:52 user nova-compute[71269]:   <serial>6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52</serial>
Apr 13 22:54:52 user nova-compute[71269]: </disk>
Apr 13 22:54:52 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:52 user nova-compute[71269]: WARNING nova.compute.manager [req-f3f4fded-8197-4d1e-9bb3-97a172a08462 req-d7da916f-9942-4a72-9402-a0da6de90251 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state active and task_state rescuing.
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updated VIF entry in instance network info cache for port 822bdb49-5f9a-4949-8543-929b1764e810. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updating instance_info_cache with network_info: [{"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bc41c41-0a10-4405-88b4-3809cc9d849e req-e20180c3-240f-436e-a784-22cfe5c3f3be service nova] Releasing lock "refresh_cache-0e10dfa7-4997-44b0-b26d-421c7a2d8b63" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] No VIF found with MAC fa:16:3e:ee:75:2f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:54:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-99a6635b-1f1d-4dca-9810-0a53fcb93d6a tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.927s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:54 user nova-compute[71269]: INFO nova.compute.manager [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Terminating instance
Apr 13 22:54:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:54 user nova-compute[71269]: WARNING nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state active and task_state rescuing.
Apr 13 22:54:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:54 user nova-compute[71269]: WARNING nova.compute.manager [req-6731d89c-6d25-4ea3-87e4-d613c348fe14 req-1b6f41cb-e8b2-44be-ae2c-f79b523ed858 service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state active and task_state rescuing.
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-unplugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] No waiting events found dispatching network-vif-unplugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-2bcd4218-e105-45f0-be4e-ae992cb34ca9 req-78c7f049-6c4e-415f-95f3-a898042c3307 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-unplugged-7c255119-87ff-437e-baec-874090c7c7e4 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Instance destroyed successfully.
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lazy-loading 'resources' on Instance uuid 636a69ed-f9b3-4b91-b371-7f7bf3e85154 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1321478870',display_name='tempest-DeleteServersTestJSON-server-1321478870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1321478870',id=2,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c86d23c9fa4c60b53700b0798a215f',ramdisk_id='',reservation_id='r-f2p7wpl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1638372531',owner_user_name='tempest-DeleteServersTestJSON-1638372531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:53:05Z,user_data=None,user_id='bcdd77e681f9467db86ff56ff8f516b4',uuid=636a69ed-f9b3-4b91-b371-7f7bf3e85154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converting VIF {"id": "7c255119-87ff-437e-baec-874090c7c7e4", "address": "fa:16:3e:ee:75:2f", "network": {"id": "aae34c52-3257-4273-a867-367f7ba854fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-856605184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c86d23c9fa4c60b53700b0798a215f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c255119-87", "ovs_interfaceid": "7c255119-87ff-437e-baec-874090c7c7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_vif [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c255119-87, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:54:55 user nova-compute[71269]: INFO os_vif [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:75:2f,bridge_name='br-int',has_traffic_filtering=True,id=7c255119-87ff-437e-baec-874090c7c7e4,network=Network(aae34c52-3257-4273-a867-367f7ba854fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c255119-87')
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPevnXsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:55 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36f160-840e-4cf0-a50d-63a146a44670]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:54:55 user nova-compute[71269]: No targets found.
Apr 13 22:54:55 user nova-compute[71269]: iSNS:
Apr 13 22:54:55 user nova-compute[71269]: No targets found.
Apr 13 22:54:55 user nova-compute[71269]: STATIC:
Apr 13 22:54:55 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:54:55 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:54:55 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:54:55 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52
Apr 13 22:54:55 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:54:55 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:54:55 user nova-compute[71269]: FIRMWARE:
Apr 13 22:54:55 user nova-compute[71269]: No targets found.
Apr 13 22:54:55 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:54:55 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:54:55 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb6481-6bd1-45c7-a612-fc4fd45bbb06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ee87f5-03dd-4aab-ba22-d4b9a0c1c2f0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:55 user nova-compute[71269]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)
Apr 13 22:54:55 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:55 user nova-compute[71269]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 (non-flash)
Apr 13 22:54:55 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc218280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a55e6c-a0a6-470c-bf1d-e48f6f682a65]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[261adc89-dc2f-448a-84a9-bd36fad63597]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8643cd81-3b84-4b1c-a18b-327b9725c915]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:55 user nova-compute[71269]: INFO nova.compute.manager [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Attaching volume 098aedca-2822-4384-bff5-58cccb0f96a0 to /dev/vdb
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[130534c2-c40b-4e7b-aa4b-efbbc3cf03f0]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4258a9d0-26b4-4937-82ec-2e7e2e00435f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.utils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed9cf4-1b87-44a5-b7ec-cc271885254a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822956a-b2a0-443a-a0ec-056a5ae70ee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e4745-6c2e-468f-bbbf-36ae64c5ac65]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260]
Apr 13 22:54:55 user nova-compute[71269]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52, portal: 172.16.0.220,3260] successful.
Apr 13 22:54:55 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e10955-5990-4d0f-b60e-f60da2323cfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for ff417f05-3cfa-4274-a0d9-9145ce1e5f83 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426495.8771334, ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:54:55 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] VM Resumed (Lifecycle Event)
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b5fbf3d-8d95-4ed4-97b6-80a773c5dc52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee070069-69a2-4b35-b7c1-bb0d4488a708]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e790c-0280-4f64-a233-5c6faf175ee3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2ce1a83b-ee3f-4cf7-86df-7ee5da0e8cfd tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] <== disconnect_volume: return (350ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:54:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Deleting instance files /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154_del
Apr 13 22:54:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Deletion of /opt/stack/data/nova/instances/636a69ed-f9b3-4b91-b371-7f7bf3e85154_del complete
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:54:55 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:54:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e117a5fe-301b-4660-9905-96da5b303fb0]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG os_brick.utils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:55 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updating existing volume attachment record: 7dd63302-8bcf-47bc-887d-83947f8f51eb {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:54:56 user nova-compute[71269]: INFO nova.compute.manager [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:54:56 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426495.8777616, ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:54:56 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] VM Started (Lifecycle Event)
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:54:56 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:56 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:54:56 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16105141-f4ba-4d60-9563-bc6c86b53c96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:54:56 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469e101-a3b5-4127-a686-6f880b2c4d8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7] added
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef974e38-8cf6-466a-a945-931b8b02636b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a689e-630a-4f19-9029-2451340931a8]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKIysTWU {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKIysTWU" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d94d3-bb17-4335-be1d-d5def9ba0231]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lKIysTWU'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0b2d8-4556-4f52-9722-3229da9a86e1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77d80af-8178-4321-b27a-6ca7e8e8da95]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[86077ef3-cb28-4a5f-ad40-83910d5fae7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]
Apr 13 22:54:56 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa673b-28b1-47c0-a276-17d6e6469843]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea027b5-8405-4751-b601-e8c6c04c94c7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:54:56 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893dc76-5c86-4346-86a8-ac1c6193cd9f]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:54:56 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:54:56 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Took 0.74 seconds to deallocate network for instance.
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Acquiring lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] No waiting events found dispatching network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:54:57 user nova-compute[71269]: WARNING nova.compute.manager [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received unexpected event network-vif-plugged-7c255119-87ff-437e-baec-874090c7c7e4 for instance with vm_state active and task_state deleting.
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-092530b9-39a0-448f-a697-fd2f38cd5963 req-2cf8bf9b-5f11-41a5-80f1-e4885f6ee153 service nova] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Received event network-vif-deleted-7c255119-87ff-437e-baec-874090c7c7e4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26235636263353739', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235636263353739', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:54:57 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:54:57 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 22:54:57 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:54:57 user nova-compute[71269]:   <serial>a58090c7-ce32-4a3f-a2f0-f327259775e7</serial>
Apr 13 22:54:57 user nova-compute[71269]: </disk>
Apr 13 22:54:57 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:54:57 user nova-compute[71269]: INFO nova.compute.manager [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Took 0.85 seconds to detach 1 volumes for instance.
Apr 13 22:54:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No VIF found with MAC fa:16:3e:03:14:a3, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:58 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Deleted allocations for instance 636a69ed-f9b3-4b91-b371-7f7bf3e85154
Apr 13 22:54:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-31c9b4e9-428a-45be-b79d-739ea5fd5494 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.145s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6942967c-68ed-4729-830a-19081787eac4 tempest-DeleteServersTestJSON-1638372531 tempest-DeleteServersTestJSON-1638372531-project-member] Lock "636a69ed-f9b3-4b91-b371-7f7bf3e85154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.644s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:54:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:00 user nova-compute[71269]: WARNING nova.compute.manager [req-d2902be3-d890-4315-bece-eab20c10e181 req-736edd2f-25d2-4df0-a67b-edb7ac3fbf28 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state active and task_state powering-off.
Apr 13 22:55:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance destroyed successfully.
Apr 13 22:55:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0328e7b8-5541-438c-9392-b1d4cdb13fc9 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.120s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCpXrfEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:00 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:00 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:00 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2af5b5-f211-4953-8442-0f15fd0530b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:00 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b52c32-c9af-4c3b-8bb7-b766d90f4e05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0] added
Apr 13 22:55:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a16ddd3-4a35-40e1-bbfe-5a2b93f2abc5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1328c442-69a9-40ae-8acc-b975d372095e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCpXrfEk {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCpXrfEk" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28d6eae-c4a1-499a-8dd1-26e06a7e2b49]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCpXrfEk'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b9137b-aec2-4abd-8686-046bd67555d4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5fb98-e63e-4565-9906-cf2d7aed7db0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe923617-9d60-4520-bc6a-cca86dea1b96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260]
Apr 13 22:55:01 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4cd21b-28f2-4457-bb21-a50c10ad97e2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2798e-8813-4068-b15b-bb7b14cfc7c3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed11d7a-2a9f-406b-8d8f-74954b2a0e74]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCpXrfEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23736633937626138', 'path': '/dev/sdd'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633937626138', 'path': '/dev/sdd'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:55:02 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:02 user nova-compute[71269]:   <source dev="/dev/sdd"/>
Apr 13 22:55:02 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:02 user nova-compute[71269]:   <serial>098aedca-2822-4384-bff5-58cccb0f96a0</serial>
Apr 13 22:55:02 user nova-compute[71269]: </disk>
Apr 13 22:55:02 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:02 user nova-compute[71269]: WARNING nova.compute.manager [req-4af8d587-748b-46a2-a4ae-911373b73847 req-ba908e10-1299-4dee-a985-d8b223b68f35 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:91:66:95, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:55:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1b179196-9b23-48b7-b12c-726fdb84841c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.073s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-changed-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Refreshing instance network info cache due to event network-changed-3958622e-6a70-4931-b630-26e0a53c5755. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:55:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Acquiring lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Acquired lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:04 user nova-compute[71269]: DEBUG nova.network.neutron [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Refreshing network info cache for port 3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:55:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updated VIF entry in instance network info cache for port 3958622e-6a70-4931-b630-26e0a53c5755. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:55:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating instance_info_cache with network_info: [{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-559e98a0-2ac3-4526-b426-91b120114900 req-c7aeab4b-4548-479d-9c87-218409bdc186 service nova] Releasing lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:55:07 user nova-compute[71269]: INFO nova.compute.claims [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Claim successful on node user
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'flavor' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-changed-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Refreshing instance network info cache due to event network-changed-444b360c-4e8d-4075-a10a-dca6e73083b0. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Acquiring lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Acquired lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.network.neutron [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Refreshing network info cache for port 444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:08 user nova-compute[71269]: INFO nova.compute.manager [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Attaching volume c927ee17-9542-43d6-8c85-5c76a402a36e to /dev/vdb
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.utils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8925df77-4f48-4ffc-82a2-1779e825d114]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9402193-c79e-4a8f-81d6-632ad68ce4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a0ac2-c961-45b4-ba0f-25aa41a1ab03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a82a0-33eb-414e-9ea1-a0f06f777df5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.policy [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:08 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0152d9-259e-4278-a8db-1d955b501640]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG os_brick.utils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating existing volume attachment record: 506a5bb0-5230-445c-bfb7-68349275231a {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:55:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Creating image(s)
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "/opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.164s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk 1073741824" returned: 0 in 0.049s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.network.neutron [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updated VIF entry in instance network info cache for port 444b360c-4e8d-4075-a10a-dca6e73083b0. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG nova.network.neutron [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updating instance_info_cache with network_info: [{"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-77c39b8f-6797-447f-895f-b295fc11ffe4 req-8a45787f-5bc0-4ae9-acd9-9f75caa83019 service nova] Releasing lock "refresh_cache-b8400cd0-5a21-4ca5-a4b6-1683897941ab" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.194s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Cannot resize image /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'migration_context' on Instance uuid 74b32176-d23e-41cb-80b2-5e8eede9ba7f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Ensure instance console log exists: /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Successfully created port: 38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Successfully updated port: 38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquired lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-changed-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Refreshing instance network info cache due to event network-changed-38a15311-5617-41cd-83a3-b253ee45f5d8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Acquiring lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updating instance_info_cache with network_info: [{"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Releasing lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Instance network_info: |[{"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Acquired lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Refreshing network info cache for port 38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Start _get_guest_xml network_info=[{"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426495.486381, 636a69ed-f9b3-4b91-b371-7f7bf3e85154 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:55:10 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] VM Stopped (Lifecycle Event)
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3f518801-052f-41bf-b6af-68e4d9195bd7 None None] [instance: 636a69ed-f9b3-4b91-b371-7f7bf3e85154] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:55:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-327963572',display_name='tempest-AttachVolumeNegativeTest-server-327963572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-327963572',id=11,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/fIOmV2oYNa5X2ielk8jHAzzKZDAmddNM9O0Vg4iA3cFAMMTj3Mu0r6iY22xgj5uoQiV5bWcCQVTWzxrknDJXU2Fxq/BhxckivvclzEiTgSKiPMw1SKzeL/rXorxQvTA==',key_name='tempest-keypair-1770675987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-v45unmx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=74b32176-d23e-41cb-80b2-5e8eede9ba7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'pci_devices' on Instance uuid 74b32176-d23e-41cb-80b2-5e8eede9ba7f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:55:10 user nova-compute[71269]:   <uuid>74b32176-d23e-41cb-80b2-5e8eede9ba7f</uuid>
Apr 13 22:55:10 user nova-compute[71269]:   <name>instance-0000000b</name>
Apr 13 22:55:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:55:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:55:10 user nova-compute[71269]:   <metadata>
Apr 13 22:55:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:55:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-327963572</nova:name>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:55:10</nova:creationTime>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:55:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:55:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:owner>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:user uuid="98594f3f6ccf4ffdbfd91bcf192d936e">tempest-AttachVolumeNegativeTest-704876090-project-member</nova:user>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:project uuid="85ccac99656842aca44f9f1eb7aa167a">tempest-AttachVolumeNegativeTest-704876090</nova:project>
Apr 13 22:55:10 user nova-compute[71269]:       </nova:owner>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:55:10 user nova-compute[71269]:       <nova:ports>
Apr 13 22:55:10 user nova-compute[71269]:         <nova:port uuid="38a15311-5617-41cd-83a3-b253ee45f5d8">
Apr 13 22:55:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:55:10 user nova-compute[71269]:         </nova:port>
Apr 13 22:55:10 user nova-compute[71269]:       </nova:ports>
Apr 13 22:55:10 user nova-compute[71269]:     </nova:instance>
Apr 13 22:55:10 user nova-compute[71269]:   </metadata>
Apr 13 22:55:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:55:10 user nova-compute[71269]:     <system>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="serial">74b32176-d23e-41cb-80b2-5e8eede9ba7f</entry>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="uuid">74b32176-d23e-41cb-80b2-5e8eede9ba7f</entry>
Apr 13 22:55:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:55:10 user nova-compute[71269]:     </system>
Apr 13 22:55:10 user nova-compute[71269]:   </sysinfo>
Apr 13 22:55:10 user nova-compute[71269]:   <os>
Apr 13 22:55:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:55:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:55:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:55:10 user nova-compute[71269]:   </os>
Apr 13 22:55:10 user nova-compute[71269]:   <features>
Apr 13 22:55:10 user nova-compute[71269]:     <acpi/>
Apr 13 22:55:10 user nova-compute[71269]:     <apic/>
Apr 13 22:55:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:55:10 user nova-compute[71269]:   </features>
Apr 13 22:55:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:55:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:55:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:55:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:55:10 user nova-compute[71269]:   </clock>
Apr 13 22:55:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:55:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:55:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:55:10 user nova-compute[71269]:   </cpu>
Apr 13 22:55:10 user nova-compute[71269]:   <devices>
Apr 13 22:55:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:55:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:55:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk"/>
Apr 13 22:55:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:55:10 user nova-compute[71269]:     </disk>
Apr 13 22:55:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:55:10 user nova-compute[71269]:       <mac address="fa:16:3e:a9:c1:97"/>
Apr 13 22:55:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:55:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:55:10 user nova-compute[71269]:       <target dev="tap38a15311-56"/>
Apr 13 22:55:10 user nova-compute[71269]:     </interface>
Apr 13 22:55:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:55:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/console.log" append="off"/>
Apr 13 22:55:10 user nova-compute[71269]:     </serial>
Apr 13 22:55:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:55:10 user nova-compute[71269]:     <video>
Apr 13 22:55:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:55:10 user nova-compute[71269]:     </video>
Apr 13 22:55:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:55:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:55:10 user nova-compute[71269]:     </rng>
Apr 13 22:55:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:55:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:55:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:55:10 user nova-compute[71269]:     </memballoon>
Apr 13 22:55:10 user nova-compute[71269]:   </devices>
Apr 13 22:55:10 user nova-compute[71269]: </domain>
Apr 13 22:55:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-327963572',display_name='tempest-AttachVolumeNegativeTest-server-327963572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-327963572',id=11,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/fIOmV2oYNa5X2ielk8jHAzzKZDAmddNM9O0Vg4iA3cFAMMTj3Mu0r6iY22xgj5uoQiV5bWcCQVTWzxrknDJXU2Fxq/BhxckivvclzEiTgSKiPMw1SKzeL/rXorxQvTA==',key_name='tempest-keypair-1770675987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-v45unmx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=74b32176-d23e-41cb-80b2-5e8eede9ba7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG os_vif [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a15311-56, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38a15311-56, col_values=(('external_ids', {'iface-id': '38a15311-5617-41cd-83a3-b253ee45f5d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:c1:97', 'vm-uuid': '74b32176-d23e-41cb-80b2-5e8eede9ba7f'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:10 user nova-compute[71269]: INFO os_vif [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56')
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:a9:c1:97, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'flavor' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:10 user nova-compute[71269]: INFO nova.compute.manager [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Attaching volume 927db7c9-e810-41e1-85b5-306c3505ec50 to /dev/sdc
Apr 13 22:55:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updated VIF entry in instance network info cache for port 38a15311-5617-41cd-83a3-b253ee45f5d8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updating instance_info_cache with network_info: [{"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a7d4eef3-b0f5-4078-8e63-948decbf7010 req-4e194ae1-08b8-47ab-844b-3a153c6804d3 service nova] Releasing lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd5e90-6935-4b49-86b2-23d2c65c3c54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cbcefd-a865-4c7a-99a3-fa4190c03905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e95dda-97c4-4324-ab39-e54d062c369b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6028c785-4da2-4b25-9dc0-1b6aaf9767e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:11 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:55:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f8591-b6b0-4527-9d8d-9d171dee8d7a]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updating existing volume attachment record: bb890788-6bb4-4de1-96bf-4f4b0facedb0 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:55:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] No waiting events found dispatching network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:12 user nova-compute[71269]: WARNING nova.compute.manager [req-7acf4857-5807-4111-831a-bd9a01e0f223 req-157761c1-51af-4674-8cf7-f27d3d3a98c3 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received unexpected event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 for instance with vm_state building and task_state spawning.
Apr 13 22:55:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHAljVwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:12 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3689b618-a48d-47b6-b63d-7b5058c760a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:12 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf8e154-3f70-44f8-a2ec-375e6b0cb3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e] added
Apr 13 22:55:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[648f62af-852c-41f1-8c36-5f54e3b13d8c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862219d-29bf-415e-a3e5-1e9d5a969a87]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHAljVwZ {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHAljVwZ" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1116841-1b9b-4a92-8f97-332a39ce1d02]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHAljVwZ'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[99acf64f-be8f-402a-b435-818076f3e764]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef675f39-2baa-4573-b10f-5ebd8241d8f5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b4120a-1bfd-4d87-a76b-df08950b48c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260]
Apr 13 22:55:13 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ac26db-b343-4588-90b7-c5058d2c4319]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[45656ed4-7347-48f3-ad55-ab9288599ad0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:13 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4a41c-85ba-4f00-af00-d7ab6e00358a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHAljVwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426514.1742501, 74b32176-d23e-41cb-80b2-5e8eede9ba7f => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] VM Resumed (Lifecycle Event)
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Instance spawned successfully.
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26639366561316535', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639366561316535', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426514.1785774, 74b32176-d23e-41cb-80b2-5e8eede9ba7f => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] VM Started (Lifecycle Event)
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'flavor' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] No waiting events found dispatching network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:14 user nova-compute[71269]: WARNING nova.compute.manager [req-198bb3c2-3e61-4f89-9485-1924add8894a req-2332a91d-73cc-49fa-9a39-1654e63e9f84 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received unexpected event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 for instance with vm_state building and task_state spawning.
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:55:14 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:14 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:14 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:14 user nova-compute[71269]:   <serial>c927ee17-9542-43d6-8c85-5c76a402a36e</serial>
Apr 13 22:55:14 user nova-compute[71269]: </disk>
Apr 13 22:55:14 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:14 user nova-compute[71269]: INFO nova.compute.manager [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Took 6.84 seconds to build instance.
Apr 13 22:55:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5197b3bc-71c4-4be3-9923-dd45cf1422e9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No VIF found with MAC fa:16:3e:bc:7d:a6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:55:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a5126c2-4235-4d32-b15b-22a9c08c1137 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.726s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:15 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426500.3063025, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:55:15 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Stopped (Lifecycle Event)
Apr 13 22:55:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d85cf1c5-e3c4-49cd-bbfa-f788b3f2f3b1 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d85cf1c5-e3c4-49cd-bbfa-f788b3f2f3b1 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:55:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoHxJSXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:16 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:16 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:16 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e576e67b-24a5-4cf0-9849-6939b6b5478e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:16 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-changed-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Refreshing instance network info cache due to event network-changed-603de7bb-7bac-4b93-b74f-d51fb87ffe46. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Acquiring lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Acquired lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Refreshing network info cache for port 603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd171e1-5784-4d9e-904c-e19f7524a7dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50] added
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a6189c-a7ae-42fb-9dbd-2ba7d59e127e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff8e53-1314-4670-9c6e-7ae3a327926f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoHxJSXa {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoHxJSXa" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e7b08-ee69-44a7-87a5-06aac62e9582]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yoHxJSXa'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee04e830-86c3-4675-bfff-9ca6f0134037]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f4be7-c08b-4745-b9e3-0e14d1512b38]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'flavor' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fcb592-a85b-4028-aed7-2ffe00891a54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260]
Apr 13 22:55:16 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bbc24d-2ef4-4383-a03c-4a829785d76f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c1f012-6e29-491c-bc85-0e2533353ded]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:16 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:16 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c49a1bb-ac73-4889-8904-f962bce6224f]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoHxJSXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:16 user nova-compute[71269]: INFO nova.compute.manager [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attaching volume 188817bf-e42d-4eff-afcf-9471de7a2767 to /dev/vdb
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.utils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ceed72-5c63-407c-8aba-ac0c86088635]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c682e4-5643-4203-82fc-b84c53764b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[94651c6d-52c6-4d38-bbaa-1977e0fad9ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495a8ee-7ca5-4776-8e2c-9d6c5db2886e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updated VIF entry in instance network info cache for port 603de7bb-7bac-4b93-b74f-d51fb87ffe46. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating instance_info_cache with network_info: [{"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:55:16 user nova-compute[71269]: INFO nova.compute.manager [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Detaching volume c927ee17-9542-43d6-8c85-5c76a402a36e
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:16 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[338cd8a0-c8dd-436e-a5ab-033158d5b904]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG os_brick.utils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating existing volume attachment record: c4dbbf46-8dd5-4686-a768-d25afad21bda {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ef752acc-77d0-4ef0-950b-65d3e9968258 req-86c68367-b7a7-4b46-828b-8ffe40995690 service nova] Releasing lock "refresh_cache-3d246d08-7efe-4307-8a37-32f4c0621128" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:16 user nova-compute[71269]: INFO nova.virt.block_device [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Attempting to driver detach volume c927ee17-9542-43d6-8c85-5c76a402a36e from mountpoint /dev/vdb
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Attempting to detach device vdb from instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:16 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:16 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:16 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:16 user nova-compute[71269]:   <serial>c927ee17-9542-43d6-8c85-5c76a402a36e</serial>
Apr 13 22:55:16 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:55:16 user nova-compute[71269]: </disk>
Apr 13 22:55:16 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully detached device vdb from instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 from the persistent domain config.
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:55:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:16 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:16 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:16 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:16 user nova-compute[71269]:   <serial>c927ee17-9542-43d6-8c85-5c76a402a36e</serial>
Apr 13 22:55:16 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:55:16 user nova-compute[71269]: </disk>
Apr 13 22:55:16 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426517.285889, 2355fe9d-511a-4e7c-ac2a-5bddc034e063 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:55:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully detached device vdb from instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 from the live domain config.
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHAljVwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:17 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23936633238313664', 'path': '/dev/sdf'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936633238313664', 'path': '/dev/sdf'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.122s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.082s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfbf84c-644a-4f96-915b-65cbfe3e44d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:55:17 user nova-compute[71269]: No targets found.
Apr 13 22:55:17 user nova-compute[71269]: iSNS:
Apr 13 22:55:17 user nova-compute[71269]: No targets found.
Apr 13 22:55:17 user nova-compute[71269]: STATIC:
Apr 13 22:55:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:55:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:55:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e
Apr 13 22:55:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50
Apr 13 22:55:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:55:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:17 user nova-compute[71269]: FIRMWARE:
Apr 13 22:55:17 user nova-compute[71269]: No targets found.
Apr 13 22:55:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:55:17 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:55:17 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f0db9-3648-4775-8173-159e93e70b91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'flavor' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4954892-7d7d-4718-95e2-63fa6aaeb7c6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e (non-flash)
Apr 13 22:55:17 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc31eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d1ea4e-b4cf-4f5e-b0f5-95fa6dff1577]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:55:17 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:17 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 22:55:17 user nova-compute[71269]:   <target dev="sdc" bus="scsi"/>
Apr 13 22:55:17 user nova-compute[71269]:   <serial>927db7c9-e810-41e1-85b5-306c3505ec50</serial>
Apr 13 22:55:17 user nova-compute[71269]:   <address type="drive" controller="0" unit="2"/>
Apr 13 22:55:17 user nova-compute[71269]: </disk>
Apr 13 22:55:17 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03881f6-7596-46cc-bceb-378ba7c2fbbf]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d82a1-6778-4902-85c0-76c79e636567]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a202a-1ad0-424e-aeb5-e31ff940bed9]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24932df-ee28-4cfd-84a8-88b7e455815d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9a70d-36d3-47af-a0a2-b9a3de0d53f4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260]
Apr 13 22:55:17 user nova-compute[71269]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c927ee17-9542-43d6-8c85-5c76a402a36e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7754e0-b1c9-4d2e-bd16-356377098a36]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] <== disconnect_volume: return (576ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No BDM found with device name sda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] No VIF found with MAC fa:16:3e:aa:18:0f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5357df-d0dc-4b24-837e-e98d24b323be tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.455s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.objects.instance [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'flavor' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-be1fa1ab-55de-4e6e-9bc0-8ae4dc9face0 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.176s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:18 user nova-compute[71269]: INFO nova.compute.manager [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Detaching volume 927db7c9-e810-41e1-85b5-306c3505ec50
Apr 13 22:55:18 user nova-compute[71269]: INFO nova.virt.block_device [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Attempting to driver detach volume 927db7c9-e810-41e1-85b5-306c3505ec50 from mountpoint /dev/sdc
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Attempting to detach device sdc from instance b8400cd0-5a21-4ca5-a4b6-1683897941ab from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:18 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:18 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 22:55:18 user nova-compute[71269]:   <target dev="sdc" bus="scsi"/>
Apr 13 22:55:18 user nova-compute[71269]:   <serial>927db7c9-e810-41e1-85b5-306c3505ec50</serial>
Apr 13 22:55:18 user nova-compute[71269]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 22:55:18 user nova-compute[71269]: </disk>
Apr 13 22:55:18 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Successfully detached device sdc from instance b8400cd0-5a21-4ca5-a4b6-1683897941ab from the persistent domain config.
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b8400cd0-5a21-4ca5-a4b6-1683897941ab from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:55:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:18 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:18 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 22:55:18 user nova-compute[71269]:   <target dev="sdc" bus="scsi"/>
Apr 13 22:55:18 user nova-compute[71269]:   <serial>927db7c9-e810-41e1-85b5-306c3505ec50</serial>
Apr 13 22:55:18 user nova-compute[71269]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 22:55:18 user nova-compute[71269]: </disk>
Apr 13 22:55:18 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426519.3529766, b8400cd0-5a21-4ca5-a4b6-1683897941ab => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:55:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Successfully detached device sdc from instance b8400cd0-5a21-4ca5-a4b6-1683897941ab from the live domain config.
Apr 13 22:55:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoHxJSXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:19 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b89343-21a7-417b-b742-df3a1774f815]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:55:19 user nova-compute[71269]: No targets found.
Apr 13 22:55:19 user nova-compute[71269]: iSNS:
Apr 13 22:55:19 user nova-compute[71269]: No targets found.
Apr 13 22:55:19 user nova-compute[71269]: STATIC:
Apr 13 22:55:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:55:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:55:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50
Apr 13 22:55:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:55:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:19 user nova-compute[71269]: FIRMWARE:
Apr 13 22:55:19 user nova-compute[71269]: No targets found.
Apr 13 22:55:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:55:19 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:55:19 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1db5e18-9cd2-41ee-8f58-e8abddd126a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cde1b5-bf98-48b2-a76c-26239d49dbe1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 (non-flash)
Apr 13 22:55:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2da440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50'): ({'sdf'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Removing single pathed devices sdf {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b9ce1-579c-4e39-aca3-25e3d21bfd85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22671248-bffa-4aec-87b1-89693b984d90]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Flushing IO for device /dev/sdf {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2dc2d7-d789-42bb-aa14-8f63158a2748]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.080s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf1530-5ec0-4405-927e-4afd98d72be3]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99391e-17fe-496f-b6a9-d9b9cc065ba6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f17e5f-c4c3-4487-97ea-7502ec1485f7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260]
Apr 13 22:55:19 user nova-compute[71269]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927db7c9-e810-41e1-85b5-306c3505ec50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def69e2-0f62-41c9-a3df-f4d56b6318c4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] <== disconnect_volume: return (357ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:55:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'flavor' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ac21f152-dfab-427e-af7a-25b7a11791a6 tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:21 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:21 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:21 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:21 user nova-compute[71269]: INFO nova.compute.manager [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Terminating instance
Apr 13 22:55:21 user nova-compute[71269]: DEBUG nova.compute.manager [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf825e29-97cc-494c-bc8e-ed40b0a4e1db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:21 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d5cec-1857-44d5-809c-e42159aabd1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767] added
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fd57c-c93e-42b7-8a0d-84435b31f464]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef9e03-b0d9-4a63-a36f-caaec4bb994a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omtLieFg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omtLieFg" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcadabfb-2943-4b0e-ba99-72a07919e51f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'omtLieFg'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c640aa-ef1d-4810-b844-b5aa622f8df4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5013a0e-d35e-4048-9a69-452c07c0bc38]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a1b198-d149-4350-8b57-6714d94cc2fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]
Apr 13 22:55:21 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bec0e18-64ff-4d27-9113-94dddb7da6d4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-unplugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] No waiting events found dispatching network-vif-unplugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-61a5f2fc-962e-43e8-8c2a-74faecadd5ec req-65f12f04-1690-4222-b0e7-9cf2870bbf1d service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-unplugged-444b360c-4e8d-4075-a10a-dca6e73083b0 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ccd01f-2f1a-47db-8268-9c1f92e0aa84]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:21 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e83504d-26bb-4867-9abf-be14fb2d42f3]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:21 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Instance destroyed successfully.
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lazy-loading 'resources' on Instance uuid b8400cd0-5a21-4ca5-a4b6-1683897941ab {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1988745821',display_name='tempest-AttachSCSIVolumeTestJSON-server-1988745821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1988745821',id=8,image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXj02oyoksF1tjWwSgW0skVN3juez2TfkFa4tY4tvPDRSVTwcYPTRDAeB0p5mOsILnlocO3X8FdWawd/NGV/BrUcM9pknOVivGHz3Nhsk+gPH86ILA1HHLQ+H7QpdJ33A==',key_name='tempest-keypair-864897906',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc753ebae6474a4b8a914b240795df82',ramdisk_id='',reservation_id='r-m7bt1u9w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='23f6496f-7550-41f3-a9ce-a6e787316117',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-791951707',owner_user_name='tempest-AttachSCSIVolumeTestJSON-791951707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d624ba67e327453881558410a112910a',uuid=b8400cd0-5a21-4ca5-a4b6-1683897941ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converting VIF {"id": "444b360c-4e8d-4075-a10a-dca6e73083b0", "address": "fa:16:3e:aa:18:0f", "network": {"id": "481c29af-0d84-43d7-af50-9139d1ff6ce2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2059676118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc753ebae6474a4b8a914b240795df82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444b360c-4e", "ovs_interfaceid": "444b360c-4e8d-4075-a10a-dca6e73083b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG os_vif [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap444b360c-4e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:22 user nova-compute[71269]: INFO os_vif [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:0f,bridge_name='br-int',has_traffic_filtering=True,id=444b360c-4e8d-4075-a10a-dca6e73083b0,network=Network(481c29af-0d84-43d7-af50-9139d1ff6ce2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap444b360c-4e')
Apr 13 22:55:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Deleting instance files /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab_del
Apr 13 22:55:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Deletion of /opt/stack/data/nova/instances/b8400cd0-5a21-4ca5-a4b6-1683897941ab_del complete
Apr 13 22:55:22 user nova-compute[71269]: INFO nova.compute.manager [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 22:55:22 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26661343935626432', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661343935626432', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'flavor' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:55:22 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:22 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:22 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:22 user nova-compute[71269]:   <serial>188817bf-e42d-4eff-afcf-9471de7a2767</serial>
Apr 13 22:55:22 user nova-compute[71269]: </disk>
Apr 13 22:55:22 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] No VIF found with MAC fa:16:3e:e6:45:59, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af464400-2d1b-4ec5-9284-06909744e914 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.838s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:23 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Took 1.15 seconds to deallocate network for instance.
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-ad80a3e2-d1a1-49aa-bbb0-963ef0baff9f req-bc481650-d03e-4d5e-bfa6-fe5cdf7dc6da service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-deleted-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Acquiring lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] No waiting events found dispatching network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:55:23 user nova-compute[71269]: WARNING nova.compute.manager [req-2a79fb00-2f13-4b8d-b4d2-6de96b694f1c req-6099bb60-ebcc-4837-a197-92b68eb25acf service nova] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Received unexpected event network-vif-plugged-444b360c-4e8d-4075-a10a-dca6e73083b0 for instance with vm_state deleted and task_state None.
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:23 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Deleted allocations for instance b8400cd0-5a21-4ca5-a4b6-1683897941ab
Apr 13 22:55:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-003dd595-ac1e-4924-a853-68381d9a226c tempest-AttachSCSIVolumeTestJSON-791951707 tempest-AttachSCSIVolumeTestJSON-791951707-project-member] Lock "b8400cd0-5a21-4ca5-a4b6-1683897941ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.505s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.utils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60dd1d-db0c-45bf-8635-56f4e8880ec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa951364-9bbe-4307-ba6b-29a6c0e44e13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed5e5a0-6c69-46a3-9f49-9fbb7dc81df6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4586cb53-757a-48b3-ac29-b2ee3c77c692]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:24 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:55:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c1ea4-be9c-449a-9918-51902a2ae168]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:55:24 user nova-compute[71269]: DEBUG os_brick.utils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:24 user nova-compute[71269]: INFO nova.compute.manager [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Swapping volume 188817bf-e42d-4eff-afcf-9471de7a2767 for 817b6726-2f87-4daa-badf-2d66c3e4fed2
Apr 13 22:55:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2', 'serial': '817b6726-2f87-4daa-badf-2d66c3e4fed2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '188817bf-e42d-4eff-afcf-9471de7a2767', 'serial'} {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:29 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:29 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:29 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcfd61-3d28-4515-81e9-e0d549285d80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:29 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[026b10fc-83a8-4e7a-ab78-897f0d2a45e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2] added
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6628ba90-80c9-454a-9b9d-a68adf944b0a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ce244-a04e-4fe7-b43d-bfc38fc39339]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPQgJTyK {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPQgJTyK" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a3cfec-eebb-4ead-8d4a-09d4e08a08d5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPQgJTyK'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[456964e5-af9e-4944-a909-693267cffa66]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6b20e-ccc3-40c5-ae6a-7d7475531fd8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cde88c-25f1-4263-8c15-8a542a40a49c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260]
Apr 13 22:55:29 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf76c1f-a672-4935-8256-bb5ecee83d4c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755582f-f6c1-4ecc-974a-21f2066b37a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[78084b1b-59dc-4119-bdce-ea18a29f8562]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26565316233623636', 'path': '/dev/sdf'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565316233623636', 'path': '/dev/sdf'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lazy-loading 'flavor' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 372244480 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 809500672 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:34 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999c154-d9c6-499c-b343-8e992dfdaa5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:55:34 user nova-compute[71269]: No targets found.
Apr 13 22:55:34 user nova-compute[71269]: iSNS:
Apr 13 22:55:34 user nova-compute[71269]: No targets found.
Apr 13 22:55:34 user nova-compute[71269]: STATIC:
Apr 13 22:55:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:55:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:55:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767
Apr 13 22:55:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:55:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2
Apr 13 22:55:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:34 user nova-compute[71269]: FIRMWARE:
Apr 13 22:55:34 user nova-compute[71269]: No targets found.
Apr 13 22:55:34 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:55:34 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:55:34 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:55:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d1b74-5314-4dcd-b023-d7d34ce031c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb7aa4e-d6ae-43f1-8176-f3c18584723d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc61feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d7db3-8736-457e-8980-d3219222a119]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be68266-c2c9-42dc-bb1d-7618484b94ec]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[14054469-f775-41d5-94ca-dba8a294f5d7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f9f8a-32ca-406e-9480-5b3bd5666b94]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ec7a5-c201-4d8c-ab1d-2a1e39d045ed]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d5f9d4-52d9-4afc-9fde-d6d430a153e7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]
Apr 13 22:55:35 user nova-compute[71269]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe610475-b238-4690-85a9-5cfa5431a1e4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== disconnect_volume: return (326ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2', 'serial'} {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 22:55:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: removing Cinder connection for volume 188817bf-e42d-4eff-afcf-9471de7a2767 {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: Updating volume 188817bf-e42d-4eff-afcf-9471de7a2767 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "pPQgJTyK", "auth_password": "oCSPv3rsgcJOde", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "817b6726-2f87-4daa-badf-2d66c3e4fed2"}, "status": "reserved", "instance": "3d246d08-7efe-4307-8a37-32f4c0621128", "attached_at": "", "detached_at": "", "volume_id": "817b6726-2f87-4daa-badf-2d66c3e4fed2", "serial": "817b6726-2f87-4daa-badf-2d66c3e4fed2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2', 'no_device': None, 'attachment_id': '206cfcfa-630e-4300-8493-ae84e7884df9'} {{(pid=71269) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-dc74f8dd-ed6d-46c5-80f1-d1ef600677a1 tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.787s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.utils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb76bf-64b4-44a6-b03d-27d09d59a2c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e812e-304c-44e6-87b0-b4215f73e550]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c22c86-0a60-4499-959d-04dcb54623d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ed681-7021-4b3b-aaa5-29d613b74d83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:55:36 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:55:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd2eb1-da24-4ee0-a323-fad98cefad7e]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:55:36 user nova-compute[71269]: DEBUG os_brick.utils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:37 user nova-compute[71269]: INFO nova.compute.manager [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Swapping volume 817b6726-2f87-4daa-badf-2d66c3e4fed2 for 188817bf-e42d-4eff-afcf-9471de7a2767
Apr 13 22:55:37 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426522.1779206, b8400cd0-5a21-4ca5-a4b6-1683897941ab => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:55:37 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] VM Stopped (Lifecycle Event)
Apr 13 22:55:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-51b952c1-4e1c-47a9-9d9e-4732ecf21bc8 None None] [instance: b8400cd0-5a21-4ca5-a4b6-1683897941ab] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:55:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '188817bf-e42d-4eff-afcf-9471de7a2767', 'serial': '188817bf-e42d-4eff-afcf-9471de7a2767'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2'}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2', 'serial'} {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:41 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:41 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:41 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5d62e4-936d-4780-aa18-ea88d865b8b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:55:41 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a296b-3347-441f-8c4d-68ffa27c5328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767] added
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[622b98b9-cfe8-4826-abf4-8d2315c3b131]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[949c4e87-856d-45f1-9a03-6cc329ff26a5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omtLieFg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omtLieFg" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee1b4e8-4ea8-4fcb-aa84-dd390133e5b3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'omtLieFg'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b94672-d7d6-4a0c-9ff1-c99a975b840b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c5713c-6e99-410f-8f6b-3c3f1ce07195]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[239b8eb7-9580-40f3-910f-8f45a6f365d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]
Apr 13 22:55:41 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc0b7f-14d4-450b-a9ee-e7ef727530d4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f9ec6-4288-4bc3-907b-7d9de38110b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:41 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7fe82d-6643-4e0b-80ad-4f916ceefcb2]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:41 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26661343935626432', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661343935626432', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lazy-loading 'flavor' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:42 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 58720256 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 234881024 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 436207616 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:55:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:55:46 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:55:46 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7978MB free_disk=26.518062591552734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQgJTyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '817b6726-2f87-4daa-badf-2d66c3e4fed2': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:47 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3d246d08-7efe-4307-8a37-32f4c0621128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1194d6d-6c34-4fc0-8e0b-07b6443b5ea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:55:47 user nova-compute[71269]: No targets found.
Apr 13 22:55:47 user nova-compute[71269]: iSNS:
Apr 13 22:55:47 user nova-compute[71269]: No targets found.
Apr 13 22:55:47 user nova-compute[71269]: STATIC:
Apr 13 22:55:47 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:55:47 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:47 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:47 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:55:47 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:47 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:47 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767
Apr 13 22:55:47 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:47 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:47 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:55:47 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:47 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:47 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2
Apr 13 22:55:47 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:47 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:47 user nova-compute[71269]: FIRMWARE:
Apr 13 22:55:47 user nova-compute[71269]: No targets found.
Apr 13 22:55:47 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:55:47 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:55:47 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823a4ec-1d22-4622-b0ec-112ac7008810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2da7c1-222d-44e9-9e28-c3e331bd7d18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:47 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb454310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2'): ({'sdf'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Removing single pathed devices sdf {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3604c7-7215-4464-8c6f-1d48ddccf70f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a61d7-dc8b-4a52-8780-cae2bac9a8ad]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Flushing IO for device /dev/sdf {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765c952-aa9a-4c6c-812b-7bc9442e6547]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c9b310-e8b3-453b-9cb9-c9d87737b319]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a92efb-4a46-4f45-9dcf-539e97890a0f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebad326-bf6d-4194-9003-5267e7b1e0d0]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260]
Apr 13 22:55:47 user nova-compute[71269]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:47 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817b6726-2f87-4daa-badf-2d66c3e4fed2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b041b7-938e-4780-a636-ab558762965e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] <== disconnect_volume: return (350ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3d246d08-7efe-4307-8a37-32f4c0621128', 'attached_at': '', 'detached_at': '', 'volume_id': '188817bf-e42d-4eff-afcf-9471de7a2767', 'serial'} {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 22:55:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: removing Cinder connection for volume 817b6726-2f87-4daa-badf-2d66c3e4fed2 {{(pid=71269) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] swap_volume: Updating volume 817b6726-2f87-4daa-badf-2d66c3e4fed2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "omtLieFg", "auth_password": "280FpVBdQcKfb6", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "188817bf-e42d-4eff-afcf-9471de7a2767"}, "status": "reserved", "instance": "3d246d08-7efe-4307-8a37-32f4c0621128", "attached_at": "", "detached_at": "", "volume_id": "188817bf-e42d-4eff-afcf-9471de7a2767", "serial": "188817bf-e42d-4eff-afcf-9471de7a2767"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '188817bf-e42d-4eff-afcf-9471de7a2767', 'no_device': None, 'attachment_id': 'e2f1f51e-2042-40b8-931a-efc9427c26a0'} {{(pid=71269) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-130ba884-9e15-48f9-a771-8f9c12cf8fdd tempest-TestVolumeSwap-1011219805 tempest-TestVolumeSwap-1011219805-project-admin] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.762s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:55:48 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:55:49 user nova-compute[71269]: INFO nova.compute.manager [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Detaching volume 188817bf-e42d-4eff-afcf-9471de7a2767
Apr 13 22:55:49 user nova-compute[71269]: INFO nova.virt.block_device [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Attempting to driver detach volume 188817bf-e42d-4eff-afcf-9471de7a2767 from mountpoint /dev/vdb
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Attempting to detach device vdb from instance 3d246d08-7efe-4307-8a37-32f4c0621128 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:49 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:49 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:49 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:49 user nova-compute[71269]:   <serial>188817bf-e42d-4eff-afcf-9471de7a2767</serial>
Apr 13 22:55:49 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:55:49 user nova-compute[71269]: </disk>
Apr 13 22:55:49 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:49 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Successfully detached device vdb from instance 3d246d08-7efe-4307-8a37-32f4c0621128 from the persistent domain config.
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d246d08-7efe-4307-8a37-32f4c0621128 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:55:49 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:55:49 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 22:55:49 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:55:49 user nova-compute[71269]:   <serial>188817bf-e42d-4eff-afcf-9471de7a2767</serial>
Apr 13 22:55:49 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:55:49 user nova-compute[71269]: </disk>
Apr 13 22:55:49 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426549.8243878, 3d246d08-7efe-4307-8a37-32f4c0621128 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:55:49 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Successfully detached device vdb from instance 3d246d08-7efe-4307-8a37-32f4c0621128 from the live domain config.
Apr 13 22:55:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omtLieFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '188817bf-e42d-4eff-afcf-9471de7a2767': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:55:49 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87744a-fbde-4c97-abb5-a7d40f753f26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:55:49 user nova-compute[71269]: No targets found.
Apr 13 22:55:49 user nova-compute[71269]: iSNS:
Apr 13 22:55:49 user nova-compute[71269]: No targets found.
Apr 13 22:55:49 user nova-compute[71269]: STATIC:
Apr 13 22:55:49 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:55:49 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:49 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:49 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:55:49 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:49 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:49 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767
Apr 13 22:55:49 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:49 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:49 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:55:49 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:55:49 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:55:49 user nova-compute[71269]: FIRMWARE:
Apr 13 22:55:49 user nova-compute[71269]: No targets found.
Apr 13 22:55:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:55:49 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:55:49 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c317ac-05f8-4e4a-881f-9662b0eb3797]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[85022b8d-9f0e-4b4d-932f-e6d47bcfdfdf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:55:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb4fdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6f0c9-d65e-42b6-8d8f-f9bf421ee022]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd61524b-4975-453b-bb87-ffa5857fbe71]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3021f2b5-17da-4caf-8d1d-bae8516c6e05]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:55:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271d5e4-f2b6-403b-a1fe-29b4a4da7ce0]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6e36e0-e7a1-4b71-a4ff-68943b30ff1d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e281e-d86b-4dad-aec2-64101dd48d30]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260]
Apr 13 22:55:50 user nova-compute[71269]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767, portal: 172.16.0.220,3260] successful.
Apr 13 22:55:50 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188817bf-e42d-4eff-afcf-9471de7a2767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a38de3-e16b-445e-8127-feecc4882a26]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] <== disconnect_volume: return (324ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'flavor' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5aa44837-e962-45a0-a15a-66021e5d73ad tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:55:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:55:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:01 user nova-compute[71269]: INFO nova.compute.manager [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Terminating instance
Apr 13 22:56:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-unplugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] No waiting events found dispatching network-vif-unplugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-837c3189-0d94-46de-9993-c3bdcfad206e req-71482cf5-1e47-4543-b4e8-889bbbd0b346 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-unplugged-919802cc-1446-473e-8f73-b2f8a10750ee for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:56:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Instance destroyed successfully.
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid 4a0a6479-bc85-4617-8225-d8169dfb2c8d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409547542',display_name='tempest-TestVolumeBootPattern-server-1409547542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409547542',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-j1jsvwj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:54:30Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=4a0a6479-bc85-4617-8225-d8169dfb2c8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "919802cc-1446-473e-8f73-b2f8a10750ee", "address": "fa:16:3e:00:68:11", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap919802cc-14", "ovs_interfaceid": "919802cc-1446-473e-8f73-b2f8a10750ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_vif [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap919802cc-14, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:02 user nova-compute[71269]: INFO os_vif [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:11,bridge_name='br-int',has_traffic_filtering=True,id=919802cc-1446-473e-8f73-b2f8a10750ee,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919802cc-14')
Apr 13 22:56:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFgmsSbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:02 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011e91e-cad1-4012-a4de-2f269c93f1fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:56:02 user nova-compute[71269]: No targets found.
Apr 13 22:56:02 user nova-compute[71269]: iSNS:
Apr 13 22:56:02 user nova-compute[71269]: No targets found.
Apr 13 22:56:02 user nova-compute[71269]: STATIC:
Apr 13 22:56:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40
Apr 13 22:56:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:56:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:56:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:02 user nova-compute[71269]: FIRMWARE:
Apr 13 22:56:02 user nova-compute[71269]: No targets found.
Apr 13 22:56:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:56:02 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:56:02 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c24e3-0f53-4e7d-96e9-aad64e9abafd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[18843078-bbe5-444e-80c4-be5877ec7e3e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2d9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eca4b4-b15f-4f5e-8c6c-e1abb0b1c8ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d3743-5c67-4a48-a88c-5eec89d6df67]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4202256e-d0da-47a4-8a6d-4e4065510136]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aaa4d9-dce4-4209-9d21-5aa9db2cece8]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e9de41b',) {{(pid=81834) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47be6ac-f489-4d9d-ab73-94b8d829a8e2]: (4, None) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f4b46-c9ad-4ec4-ac69-ef191e2a9036]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a32bf7f-070e-4829-80f6-89ef3fe283ca]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260]
Apr 13 22:56:03 user nova-compute[71269]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40, portal: 172.16.0.220,3260] successful.
Apr 13 22:56:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc33cc39-2831-4966-ac69-82b1b4c77c40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab693e4-6b04-482e-ae7a-d78e1a52a808]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (328ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:56:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Deleting instance files /opt/stack/data/nova/instances/4a0a6479-bc85-4617-8225-d8169dfb2c8d_del
Apr 13 22:56:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Deletion of /opt/stack/data/nova/instances/4a0a6479-bc85-4617-8225-d8169dfb2c8d_del complete
Apr 13 22:56:03 user nova-compute[71269]: INFO nova.compute.manager [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 22:56:03 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:03 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Took 0.56 seconds to deallocate network for instance.
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-deleted-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:03 user nova-compute[71269]: INFO nova.compute.manager [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Neutron deleted interface 919802cc-1446-473e-8f73-b2f8a10750ee; detaching it from the instance and deleting it from the info cache
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.network.neutron [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-09ba0011-5864-4be7-90b9-632b03fe16f0 req-7f515ccf-d240-4fe8-a591-c0e5973968e1 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Detach interface failed, port_id=919802cc-1446-473e-8f73-b2f8a10750ee, reason: Instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Acquiring lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] No waiting events found dispatching network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:04 user nova-compute[71269]: WARNING nova.compute.manager [req-312c38bd-2a26-4057-9818-37222e829d36 req-04b709d2-0ae0-4511-aa34-9b95c6e5bde2 service nova] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Received unexpected event network-vif-plugged-919802cc-1446-473e-8f73-b2f8a10750ee for instance with vm_state active and task_state deleting.
Apr 13 22:56:04 user nova-compute[71269]: INFO nova.compute.manager [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Took 0.89 seconds to detach 1 volumes for instance.
Apr 13 22:56:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Deleting volume: fc33cc39-2831-4966-ac69-82b1b4c77c40 {{(pid=71269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:05 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:05 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:05 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance 4a0a6479-bc85-4617-8225-d8169dfb2c8d
Apr 13 22:56:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-01f04880-0db7-4929-859d-dcf03ff6d708 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "4a0a6479-bc85-4617-8225-d8169dfb2c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.190s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:56:08 user nova-compute[71269]: INFO nova.compute.claims [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Claim successful on node user
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:56:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:56:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Creating image(s)
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "/opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "/opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.126s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk 1073741824" returned: 0 in 0.054s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.policy [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1b08dea04784bc3b07195f951a84bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33cf3bf67714b0ba9c7f703a1c9e5b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Cannot resize image /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'migration_context' on Instance uuid c10b97ca-3231-41fe-9de5-03cd6dc81e07 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Ensure instance console log exists: /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Successfully created port: d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Successfully updated port: d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquired lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-changed-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Refreshing instance network info cache due to event network-changed-d8c122f3-f485-406e-87b1-c547eabd5bf3. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Acquiring lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Updating instance_info_cache with network_info: [{"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Releasing lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Instance network_info: |[{"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Acquired lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Refreshing network info cache for port d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Start _get_guest_xml network_info=[{"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:56:11 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:11 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632020151',display_name='tempest-VolumesAdminNegativeTest-server-1632020151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632020151',id=12,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-9dop6icl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:09Z,user_data=None,user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=c10b97ca-3231-41fe-9de5-03cd6dc81e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'pci_devices' on Instance uuid c10b97ca-3231-41fe-9de5-03cd6dc81e07 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:56:11 user nova-compute[71269]:   <uuid>c10b97ca-3231-41fe-9de5-03cd6dc81e07</uuid>
Apr 13 22:56:11 user nova-compute[71269]:   <name>instance-0000000c</name>
Apr 13 22:56:11 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:56:11 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:56:11 user nova-compute[71269]:   <metadata>
Apr 13 22:56:11 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:56:11 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1632020151</nova:name>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:56:11</nova:creationTime>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:56:11 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:56:11 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:owner>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:user uuid="e1b08dea04784bc3b07195f951a84bfb">tempest-VolumesAdminNegativeTest-357530992-project-member</nova:user>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:project uuid="a33cf3bf67714b0ba9c7f703a1c9e5b9">tempest-VolumesAdminNegativeTest-357530992</nova:project>
Apr 13 22:56:11 user nova-compute[71269]:       </nova:owner>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:56:11 user nova-compute[71269]:       <nova:ports>
Apr 13 22:56:11 user nova-compute[71269]:         <nova:port uuid="d8c122f3-f485-406e-87b1-c547eabd5bf3">
Apr 13 22:56:11 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 22:56:11 user nova-compute[71269]:         </nova:port>
Apr 13 22:56:11 user nova-compute[71269]:       </nova:ports>
Apr 13 22:56:11 user nova-compute[71269]:     </nova:instance>
Apr 13 22:56:11 user nova-compute[71269]:   </metadata>
Apr 13 22:56:11 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:56:11 user nova-compute[71269]:     <system>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="serial">c10b97ca-3231-41fe-9de5-03cd6dc81e07</entry>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="uuid">c10b97ca-3231-41fe-9de5-03cd6dc81e07</entry>
Apr 13 22:56:11 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:56:11 user nova-compute[71269]:     </system>
Apr 13 22:56:11 user nova-compute[71269]:   </sysinfo>
Apr 13 22:56:11 user nova-compute[71269]:   <os>
Apr 13 22:56:11 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:56:11 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:56:11 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:56:11 user nova-compute[71269]:   </os>
Apr 13 22:56:11 user nova-compute[71269]:   <features>
Apr 13 22:56:11 user nova-compute[71269]:     <acpi/>
Apr 13 22:56:11 user nova-compute[71269]:     <apic/>
Apr 13 22:56:11 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:56:11 user nova-compute[71269]:   </features>
Apr 13 22:56:11 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:56:11 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:56:11 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:56:11 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:56:11 user nova-compute[71269]:   </clock>
Apr 13 22:56:11 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:56:11 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:56:11 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:56:11 user nova-compute[71269]:   </cpu>
Apr 13 22:56:11 user nova-compute[71269]:   <devices>
Apr 13 22:56:11 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:11 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:11 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk"/>
Apr 13 22:56:11 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:56:11 user nova-compute[71269]:     </disk>
Apr 13 22:56:11 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:56:11 user nova-compute[71269]:       <mac address="fa:16:3e:87:0e:6c"/>
Apr 13 22:56:11 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:11 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:56:11 user nova-compute[71269]:       <target dev="tapd8c122f3-f4"/>
Apr 13 22:56:11 user nova-compute[71269]:     </interface>
Apr 13 22:56:11 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:56:11 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/console.log" append="off"/>
Apr 13 22:56:11 user nova-compute[71269]:     </serial>
Apr 13 22:56:11 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:56:11 user nova-compute[71269]:     <video>
Apr 13 22:56:11 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:11 user nova-compute[71269]:     </video>
Apr 13 22:56:11 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:56:11 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:56:11 user nova-compute[71269]:     </rng>
Apr 13 22:56:11 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:56:11 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:56:11 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:56:11 user nova-compute[71269]:     </memballoon>
Apr 13 22:56:11 user nova-compute[71269]:   </devices>
Apr 13 22:56:11 user nova-compute[71269]: </domain>
Apr 13 22:56:11 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632020151',display_name='tempest-VolumesAdminNegativeTest-server-1632020151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632020151',id=12,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-9dop6icl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:09Z,user_data=None,user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=c10b97ca-3231-41fe-9de5-03cd6dc81e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG os_vif [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c122f3-f4, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c122f3-f4, col_values=(('external_ids', {'iface-id': 'd8c122f3-f485-406e-87b1-c547eabd5bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:0e:6c', 'vm-uuid': 'c10b97ca-3231-41fe-9de5-03cd6dc81e07'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:11 user nova-compute[71269]: INFO os_vif [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4')
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] No VIF found with MAC fa:16:3e:87:0e:6c, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Updated VIF entry in instance network info cache for port d8c122f3-f485-406e-87b1-c547eabd5bf3. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Updating instance_info_cache with network_info: [{"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-07aef02c-27a9-490a-a708-8aace601c0ce req-25de4526-c6db-4af6-9a7f-629f76c43133 service nova] Releasing lock "refresh_cache-c10b97ca-3231-41fe-9de5-03cd6dc81e07" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:13 user nova-compute[71269]: WARNING nova.compute.manager [req-b0da474f-66ac-4529-993d-16c9cc829a9f req-d234e7c9-83d1-4d6b-8a26-dac5179025a1 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state building and task_state spawning.
Apr 13 22:56:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:15 user nova-compute[71269]: WARNING nova.compute.manager [req-c5e6c772-a035-47f9-a734-a01f618fa995 req-3cc56cb3-385a-4f92-bedb-4f79fc3e04e8 service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state building and task_state spawning.
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426575.2236142, c10b97ca-3231-41fe-9de5-03cd6dc81e07 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] VM Resumed (Lifecycle Event)
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Instance spawned successfully.
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426575.2266245, c10b97ca-3231-41fe-9de5-03cd6dc81e07 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] VM Started (Lifecycle Event)
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Took 6.74 seconds to spawn the instance on the hypervisor.
Apr 13 22:56:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:15 user nova-compute[71269]: INFO nova.compute.manager [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Took 7.49 seconds to build instance.
Apr 13 22:56:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2112eb79-65c0-4681-9349-e8f4d80574e3 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.577s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:17 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426562.7103188, 4a0a6479-bc85-4617-8225-d8169dfb2c8d => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:17 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] VM Stopped (Lifecycle Event)
Apr 13 22:56:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa36af8e-ed36-4737-879b-34286e2af97a None None] [instance: 4a0a6479-bc85-4617-8225-d8169dfb2c8d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'flavor' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:31 user nova-compute[71269]: INFO nova.compute.manager [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attaching volume ad4438c6-dc98-4b87-b570-3881b3bde779 to /dev/vdb
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.utils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[23012632-3080-485f-a207-a101aefe4af0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[32542d54-56cf-4b1a-9092-e891d089dc8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8752fa0-0ec1-4aa2-8e7a-6d4d97c7e500]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[945c1ffe-992f-41e1-b76e-bc413e9dc9fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:56:31 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:56:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e908aa-afdf-49cb-a93d-c1510965879e]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG os_brick.utils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating existing volume attachment record: 1976742c-951f-42e2-b907-d310deea7477 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:56:33 user nova-compute[71269]: INFO nova.compute.claims [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Claim successful on node user
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:56:34 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:56:34 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Creating image(s)
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "/opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.policy [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk 1073741824" returned: 0 in 0.054s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:56:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Successfully created port: eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Cannot resize image /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'migration_context' on Instance uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Ensure instance console log exists: /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Successfully updated port: eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-changed-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Refreshing instance network info cache due to event network-changed-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Acquiring lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Instance network_info: |[{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Acquired lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Refreshing network info cache for port eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Start _get_guest_xml network_info=[{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:36 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:36 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:36 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:36 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1319911046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1319911046',id=13,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-3t8pam19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:34Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=7226cc11-4c2c-4a27-bb02-87ba1f749d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caac7a7-fe25-4482-9690-66e1fc4815a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:56:36 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:56:36 user nova-compute[71269]:   <uuid>7226cc11-4c2c-4a27-bb02-87ba1f749d33</uuid>
Apr 13 22:56:36 user nova-compute[71269]:   <name>instance-0000000d</name>
Apr 13 22:56:36 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:56:36 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:56:36 user nova-compute[71269]:   <metadata>
Apr 13 22:56:36 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:56:36 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1319911046</nova:name>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:56:36</nova:creationTime>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:56:36 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:56:36 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:owner>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 22:56:36 user nova-compute[71269]:       </nova:owner>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:56:36 user nova-compute[71269]:       <nova:ports>
Apr 13 22:56:36 user nova-compute[71269]:         <nova:port uuid="eefcee78-4e09-44b9-ad0c-7b7ee693a6fb">
Apr 13 22:56:36 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 22:56:36 user nova-compute[71269]:         </nova:port>
Apr 13 22:56:36 user nova-compute[71269]:       </nova:ports>
Apr 13 22:56:36 user nova-compute[71269]:     </nova:instance>
Apr 13 22:56:36 user nova-compute[71269]:   </metadata>
Apr 13 22:56:36 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:56:36 user nova-compute[71269]:     <system>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="serial">7226cc11-4c2c-4a27-bb02-87ba1f749d33</entry>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="uuid">7226cc11-4c2c-4a27-bb02-87ba1f749d33</entry>
Apr 13 22:56:36 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:56:36 user nova-compute[71269]:     </system>
Apr 13 22:56:36 user nova-compute[71269]:   </sysinfo>
Apr 13 22:56:36 user nova-compute[71269]:   <os>
Apr 13 22:56:36 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:56:36 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:56:36 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:56:36 user nova-compute[71269]:   </os>
Apr 13 22:56:36 user nova-compute[71269]:   <features>
Apr 13 22:56:36 user nova-compute[71269]:     <acpi/>
Apr 13 22:56:36 user nova-compute[71269]:     <apic/>
Apr 13 22:56:36 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:56:36 user nova-compute[71269]:   </features>
Apr 13 22:56:36 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:56:36 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:56:36 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:56:36 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:56:36 user nova-compute[71269]:   </clock>
Apr 13 22:56:36 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:56:36 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:56:36 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:56:36 user nova-compute[71269]:   </cpu>
Apr 13 22:56:36 user nova-compute[71269]:   <devices>
Apr 13 22:56:36 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:36 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:36 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk"/>
Apr 13 22:56:36 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:56:36 user nova-compute[71269]:     </disk>
Apr 13 22:56:36 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:56:36 user nova-compute[71269]:       <mac address="fa:16:3e:23:2c:2d"/>
Apr 13 22:56:36 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:36 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:56:36 user nova-compute[71269]:       <target dev="tapeefcee78-4e"/>
Apr 13 22:56:36 user nova-compute[71269]:     </interface>
Apr 13 22:56:36 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:56:36 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/console.log" append="off"/>
Apr 13 22:56:36 user nova-compute[71269]:     </serial>
Apr 13 22:56:36 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:56:36 user nova-compute[71269]:     <video>
Apr 13 22:56:36 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:36 user nova-compute[71269]:     </video>
Apr 13 22:56:36 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:56:36 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:56:36 user nova-compute[71269]:     </rng>
Apr 13 22:56:36 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:56:36 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:56:36 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:56:36 user nova-compute[71269]:     </memballoon>
Apr 13 22:56:36 user nova-compute[71269]:   </devices>
Apr 13 22:56:36 user nova-compute[71269]: </domain>
Apr 13 22:56:36 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1319911046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1319911046',id=13,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-3t8pam19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:34Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=7226cc11-4c2c-4a27-bb02-87ba1f749d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_vif [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeefcee78-4e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeefcee78-4e, col_values=(('external_ids', {'iface-id': 'eefcee78-4e09-44b9-ad0c-7b7ee693a6fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:2c:2d', 'vm-uuid': '7226cc11-4c2c-4a27-bb02-87ba1f749d33'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[079863ca-5759-4675-8ad6-8944d99e5536]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779] added
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:36 user nova-compute[71269]: INFO os_vif [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e')
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a592ac-83d9-44aa-9294-d3f505187c33]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0e5bf-04d9-4a87-b007-76f7dc426437]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVeGoxqB {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVeGoxqB" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fb50f-9bae-47df-b80d-5b71aee49b7d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVeGoxqB'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:23:2c:2d, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2cc22-a73c-4f08-acb3-b67539c229b5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c27a37-d0d8-4da9-b048-e7fb38cf27be]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b50360-08ad-4b87-b5e0-ec3c681772a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260]
Apr 13 22:56:36 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260] successful.
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191a287-6262-46a9-8110-a4bdd15ddc80]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce3e109-4cbd-468f-9de3-fcb3406d09a4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27b7e6f-194a-40aa-8c9c-d02c093de377]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updated VIF entry in instance network info cache for port eefcee78-4e09-44b9-ad0c-7b7ee693a6fb. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-38272fcc-ca7e-43ae-88a8-b474e625d5fa req-f0d08e41-6e84-45c9-98fd-cce4b7a58bd4 service nova] Releasing lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23339373639316262', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339373639316262', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG nova.objects.instance [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'flavor' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:56:37 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:56:37 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 22:56:37 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:56:37 user nova-compute[71269]:   <serial>ad4438c6-dc98-4b87-b570-3881b3bde779</serial>
Apr 13 22:56:37 user nova-compute[71269]: </disk>
Apr 13 22:56:37 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] No waiting events found dispatching network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:38 user nova-compute[71269]: WARNING nova.compute.manager [req-a4dd536b-f1e9-4dfb-9300-4a4485700791 req-e23f5c26-72e5-41d8-8265-f47fcdf644e4 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received unexpected event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance with vm_state building and task_state spawning.
Apr 13 22:56:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No VIF found with MAC fa:16:3e:66:5b:e9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78d4c213-bd12-484d-b15f-01e459495d28 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.392s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: INFO nova.compute.manager [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Rescuing
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:39 user nova-compute[71269]: INFO nova.compute.manager [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Terminating instance
Apr 13 22:56:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:40 user nova-compute[71269]: WARNING nova.compute.manager [req-435c8914-3acb-4ac2-a71c-7d3963d48a33 req-e2063403-768d-457c-9d08-8ec55dc80808 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state active and task_state rescuing.
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] No waiting events found dispatching network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:40 user nova-compute[71269]: WARNING nova.compute.manager [req-64b21c92-d945-49fa-87c4-5fe2c7dad78c req-337c3660-362c-44b5-82ce-034a966d3e73 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received unexpected event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance with vm_state building and task_state spawning.
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance destroyed successfully.
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attempting a stable device rescue
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Instance destroyed successfully.
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.objects.instance [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lazy-loading 'resources' on Instance uuid 3d246d08-7efe-4307-8a37-32f4c0621128 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-519422002',display_name='tempest-TestVolumeSwap-server-519422002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-519422002',id=9,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/rpH+TiQwOSAqxTgoxwVRyx6Xsj2Nna6t2S66aajDjD8Allx8sB6ScX+MnwX9OU0lN861st5YAbEYWblv9K5uoyp9FWTta6tO5LPbohE9CGSW6ew7DKfx9QVGP5Xsfcw==',key_name='tempest-keypair-2139033731',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f871045289a43d18b339d3dac4d0666',ramdisk_id='',reservation_id='r-b1jom9ky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1308560563',owner_user_name='tempest-TestVolumeSwap-1308560563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20751f66f6564d04807dc09a675aef70',uuid=3d246d08-7efe-4307-8a37-32f4c0621128,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converting VIF {"id": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "address": "fa:16:3e:e6:45:59", "network": {"id": "cec66c14-1035-4217-905f-2797d42000d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1180998543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f871045289a43d18b339d3dac4d0666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603de7bb-7b", "ovs_interfaceid": "603de7bb-7bac-4b93-b74f-d51fb87ffe46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG os_vif [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap603de7bb-7b, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:40 user nova-compute[71269]: INFO os_vif [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:45:59,bridge_name='br-int',has_traffic_filtering=True,id=603de7bb-7bac-4b93-b74f-d51fb87ffe46,network=Network(cec66c14-1035-4217-905f-2797d42000d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603de7bb-7b')
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Deleting instance files /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128_del
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Deletion of /opt/stack/data/nova/instances/3d246d08-7efe-4307-8a37-32f4c0621128_del complete
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Creating image(s)
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426600.9544637, 7226cc11-4c2c-4a27-bb02-87ba1f749d33 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] VM Resumed (Lifecycle Event)
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:56:40 user nova-compute[71269]: INFO nova.compute.manager [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 13 22:56:40 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:56:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Instance spawned successfully.
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:56:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426600.9574358, 7226cc11-4c2c-4a27-bb02-87ba1f749d33 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] VM Started (Lifecycle Event)
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.virt.images [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] c843b543-e4c9-4201-984c-e4b14f1c0d99 was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:56:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.part /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:56:42 user nova-compute[71269]: INFO nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Took 7.66 seconds to spawn the instance on the hypervisor.
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:42 user nova-compute[71269]: INFO nova.compute.manager [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Took 8.53 seconds to build instance.
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:42 user nova-compute[71269]: WARNING nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state active and task_state rescuing.
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-unplugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] No waiting events found dispatching network-vif-unplugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-unplugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Acquiring lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] Lock "3d246d08-7efe-4307-8a37-32f4c0621128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] No waiting events found dispatching network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:42 user nova-compute[71269]: WARNING nova.compute.manager [req-1f237995-f4dc-4e11-817c-e5dff6c8759f req-6993e3ac-03c4-4a15-ae9f-99ec2fd0ba8f service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received unexpected event network-vif-plugged-603de7bb-7bac-4b93-b74f-d51fb87ffe46 for instance with vm_state active and task_state deleting.
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a36d493-0a8e-45ec-9712-0fba89cb380a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.716s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.part /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.converted" returned: 0 in 0.284s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.518s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931 --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931,backing_fmt=raw /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931,backing_fmt=raw /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue" returned: 0 in 0.055s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'migration_context' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start _get_guest_xml network_info=[{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "vif_mac": "fa:16:3e:66:5b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c843b543-e4c9-4201-984c-e4b14f1c0d99', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '1976742c-951f-42e2-b907-d310deea7477', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3f241623-e618-42eb-87d1-0606e37ec499', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad4438c6-dc98-4b87-b570-3881b3bde779', 'serial': 'ad4438c6-dc98-4b87-b570-3881b3bde779'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'resources' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:42 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:42 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:42 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:42 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:42 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8af217-1990-4399-b5f0-f024d6234280]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cVeGoxqB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 22:56:42 user nova-compute[71269]: node.name = iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:56:42 user nova-compute[71269]: node.tpgt = -1
Apr 13 22:56:42 user nova-compute[71269]: node.startup = automatic
Apr 13 22:56:42 user nova-compute[71269]: node.leading_login = No
Apr 13 22:56:42 user nova-compute[71269]: iface.iscsi_ifacename = default
Apr 13 22:56:42 user nova-compute[71269]: iface.net_ifacename = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.ipaddress = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.prefix_len = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.hwaddress = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.transport_name = tcp
Apr 13 22:56:42 user nova-compute[71269]: iface.initiatorname = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.vlan_id = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.vlan_priority = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.vlan_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.iface_num = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.mtu = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.port = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.bootproto = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.subnet_mask = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.gateway = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_alt_client_id = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_dns = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_learn_iqn = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_vendor_id_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_vendor_id = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.dhcp_slp_da = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.fragmentation = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.gratuitous_arp = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.incoming_forwarding = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.tos_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.tos = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.ttl = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.delayed_ack = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.tcp_nagle = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.tcp_wsf_state = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.tcp_wsf = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.tcp_timer_scale = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.tcp_timestamp = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.redirect = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.def_task_mgmt_timeout = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.header_digest = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.data_digest = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.immediate_data = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.initial_r2t = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.data_seq_inorder = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.data_pdu_inorder = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.erl = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.max_receive_data_len = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.first_burst_len = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.max_outstanding_r2t = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.max_burst_len = 0
Apr 13 22:56:42 user nova-compute[71269]: iface.chap_auth = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.bidi_chap = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.strict_login_compliance = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.discovery_auth = <empty>
Apr 13 22:56:42 user nova-compute[71269]: iface.discovery_logout = <empty>
Apr 13 22:56:42 user nova-compute[71269]: node.discovery_address = <empty>
Apr 13 22:56:42 user nova-compute[71269]: node.discovery_port = 0
Apr 13 22:56:42 user nova-compute[71269]: node.discovery_type = static
Apr 13 22:56:42 user nova-compute[71269]: node.session.initial_cmdsn = 0
Apr 13 22:56:42 user nova-compute[71269]: node.session.initial_login_retry_max = 8
Apr 13 22:56:42 user nova-compute[71269]: node.session.xmit_thread_priority = -20
Apr 13 22:56:42 user nova-compute[71269]: node.session.cmds_max = 128
Apr 13 22:56:42 user nova-compute[71269]: node.session.queue_depth = 32
Apr 13 22:56:42 user nova-compute[71269]: node.session.nr_sessions = 1
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.authmethod = CHAP
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.username = cVeGoxqB
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.password = ***
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.username_in = <empty>
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.password_in = <empty>
Apr 13 22:56:42 user nova-compute[71269]: node.session.auth.chap_algs = MD5
Apr 13 22:56:42 user nova-compute[71269]: node.session.timeo.replacement_timeout = 120
Apr 13 22:56:42 user nova-compute[71269]: node.session.err_timeo.abort_timeout = 15
Apr 13 22:56:42 user nova-compute[71269]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 22:56:42 user nova-compute[71269]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 22:56:42 user nova-compute[71269]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.FastAbort = Yes
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.InitialR2T = No
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.ImmediateData = Yes
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.MaxConnections = 1
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 22:56:42 user nova-compute[71269]: node.session.iscsi.ERL = 0
Apr 13 22:56:42 user nova-compute[71269]: node.session.scan = manual
Apr 13 22:56:42 user nova-compute[71269]: node.session.reopen_max = 0
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].address = 172.16.0.220
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].port = 3260
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].startup = manual
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].tcp.window_size = 524288
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].tcp.type_of_service = 0
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].timeo.logout_timeout = 15
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].timeo.login_timeout = 15
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].timeo.auth_timeout = 45
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.DataDigest = None
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.IFMarker = No
Apr 13 22:56:42 user nova-compute[71269]: node.conn[0].iscsi.OFMarker = No
Apr 13 22:56:42 user nova-compute[71269]: # END RECORD
Apr 13 22:56:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251ee17-2cbe-4d99-bfc1-7c4a02205d45]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03195d-208e-4acc-97fd-b51cbea5bbb6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVeGoxqB {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVeGoxqB" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359df86-7673-44f8-8e5c-70f1e79dacb9]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVeGoxqB'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d14e67-0dce-4c33-a0a8-e5e4d1e99f84]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe0ff8e-18fe-4e5c-81b4-2aa7cf058532]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1353dd-dd1a-4676-a56f-89fe3a992c8a]: (4, ('0 0 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23339373639316262', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339373639316262', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1424032268',display_name='tempest-ServerStableDeviceRescueTest-server-1424032268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1424032268',id=1,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReEIIBUGN/js2VOAZ0TEIC4I0cZ3TqzAV1r7zPJAF/zIEIbTTJ6VirMRIqofzAmD3hSWWBbJmL3KAKtQPR9xf0O/2/ghxrWTFBBAxj0zncVIMD3cx/w1GJEFykqUBh0Q==',key_name='tempest-keypair-1726987531',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d502d982f4fe424a8df8149962d46963',ramdisk_id='',reservation_id='r-ca12h6n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-149870328',owner_user_name='tempest-ServerStableDeviceRescueTest-149870328-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f03ab225421441098f94350bef24442',uuid=3f241623-e618-42eb-87d1-0606e37ec499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "vif_mac": "fa:16:3e:66:5b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converting VIF {"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "vif_mac": "fa:16:3e:66:5b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:56:43 user nova-compute[71269]:   <uuid>3f241623-e618-42eb-87d1-0606e37ec499</uuid>
Apr 13 22:56:43 user nova-compute[71269]:   <name>instance-00000001</name>
Apr 13 22:56:43 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:56:43 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:56:43 user nova-compute[71269]:   <metadata>
Apr 13 22:56:43 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:56:43 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1424032268</nova:name>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:56:42</nova:creationTime>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:56:43 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:56:43 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:owner>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:user uuid="3f03ab225421441098f94350bef24442">tempest-ServerStableDeviceRescueTest-149870328-project-member</nova:user>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:project uuid="d502d982f4fe424a8df8149962d46963">tempest-ServerStableDeviceRescueTest-149870328</nova:project>
Apr 13 22:56:43 user nova-compute[71269]:       </nova:owner>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:56:43 user nova-compute[71269]:       <nova:ports>
Apr 13 22:56:43 user nova-compute[71269]:         <nova:port uuid="87e984d6-f653-4e7e-a230-53cd27a17d97">
Apr 13 22:56:43 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 22:56:43 user nova-compute[71269]:         </nova:port>
Apr 13 22:56:43 user nova-compute[71269]:       </nova:ports>
Apr 13 22:56:43 user nova-compute[71269]:     </nova:instance>
Apr 13 22:56:43 user nova-compute[71269]:   </metadata>
Apr 13 22:56:43 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:56:43 user nova-compute[71269]:     <system>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="serial">3f241623-e618-42eb-87d1-0606e37ec499</entry>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="uuid">3f241623-e618-42eb-87d1-0606e37ec499</entry>
Apr 13 22:56:43 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:56:43 user nova-compute[71269]:     </system>
Apr 13 22:56:43 user nova-compute[71269]:   </sysinfo>
Apr 13 22:56:43 user nova-compute[71269]:   <os>
Apr 13 22:56:43 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:56:43 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:56:43 user nova-compute[71269]:   </os>
Apr 13 22:56:43 user nova-compute[71269]:   <features>
Apr 13 22:56:43 user nova-compute[71269]:     <acpi/>
Apr 13 22:56:43 user nova-compute[71269]:     <apic/>
Apr 13 22:56:43 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:56:43 user nova-compute[71269]:   </features>
Apr 13 22:56:43 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:56:43 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:56:43 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:56:43 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:56:43 user nova-compute[71269]:   </clock>
Apr 13 22:56:43 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:56:43 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:56:43 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:56:43 user nova-compute[71269]:   </cpu>
Apr 13 22:56:43 user nova-compute[71269]:   <devices>
Apr 13 22:56:43 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:43 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:43 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk"/>
Apr 13 22:56:43 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:56:43 user nova-compute[71269]:     </disk>
Apr 13 22:56:43 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:56:43 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:56:43 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 22:56:43 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:56:43 user nova-compute[71269]:       <serial>ad4438c6-dc98-4b87-b570-3881b3bde779</serial>
Apr 13 22:56:43 user nova-compute[71269]:     </disk>
Apr 13 22:56:43 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:43 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:43 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue"/>
Apr 13 22:56:43 user nova-compute[71269]:       <target dev="vdc" bus="virtio"/>
Apr 13 22:56:43 user nova-compute[71269]:       <boot order="1"/>
Apr 13 22:56:43 user nova-compute[71269]:     </disk>
Apr 13 22:56:43 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:56:43 user nova-compute[71269]:       <mac address="fa:16:3e:66:5b:e9"/>
Apr 13 22:56:43 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:43 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:56:43 user nova-compute[71269]:       <target dev="tap87e984d6-f6"/>
Apr 13 22:56:43 user nova-compute[71269]:     </interface>
Apr 13 22:56:43 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:56:43 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/console.log" append="off"/>
Apr 13 22:56:43 user nova-compute[71269]:     </serial>
Apr 13 22:56:43 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:56:43 user nova-compute[71269]:     <video>
Apr 13 22:56:43 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:43 user nova-compute[71269]:     </video>
Apr 13 22:56:43 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:56:43 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:56:43 user nova-compute[71269]:     </rng>
Apr 13 22:56:43 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:56:43 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:56:43 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:56:43 user nova-compute[71269]:     </memballoon>
Apr 13 22:56:43 user nova-compute[71269]:   </devices>
Apr 13 22:56:43 user nova-compute[71269]: </domain>
Apr 13 22:56:43 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:56:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance destroyed successfully.
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:43 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Took 2.14 seconds to deallocate network for instance.
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Received event network-vif-deleted-603de7bb-7bac-4b93-b74f-d51fb87ffe46 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:43 user nova-compute[71269]: INFO nova.compute.manager [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Neutron deleted interface 603de7bb-7bac-4b93-b74f-d51fb87ffe46; detaching it from the instance and deleting it from the info cache
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] No VIF found with MAC fa:16:3e:66:5b:e9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-18ccff89-d125-4eea-a2dc-fc31920ad605 req-e23535db-9a08-4271-b134-1cba8fc71309 service nova] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Detach interface failed, port_id=603de7bb-7bac-4b93-b74f-d51fb87ffe46, reason: Instance 3d246d08-7efe-4307-8a37-32f4c0621128 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:43 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Deleted allocations for instance 3d246d08-7efe-4307-8a37-32f4c0621128
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-303e976a-bfa8-41e5-8bc1-2bc207340db6 tempest-TestVolumeSwap-1308560563 tempest-TestVolumeSwap-1308560563-project-member] Lock "3d246d08-7efe-4307-8a37-32f4c0621128" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.193s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:45 user nova-compute[71269]: WARNING nova.compute.manager [req-2d429155-e22a-44cf-a2bf-9d6e07303a79 req-85175d51-d4f6-4d54-b925-26d84a4a4a4e service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state active and task_state rescuing.
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 3f241623-e618-42eb-87d1-0606e37ec499 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426607.053169, 3f241623-e618-42eb-87d1-0606e37ec499 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Resumed (Lifecycle Event)
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14c9649f-ed33-4bf0-b499-28beb1b070ef tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426607.064076, 3f241623-e618-42eb-87d1-0606e37ec499 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Started (Lifecycle Event)
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:47 user nova-compute[71269]: WARNING nova.compute.manager [req-4ab454a9-f86b-4f51-8c34-257847337359 req-90f66631-278b-475a-ad41-d776e1617ce5 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state rescued and task_state None.
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8064MB free_disk=26.463821411132812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:56:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:49 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.network.neutron [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'info_cache' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:56:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance destroyed successfully.
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'resources' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c47f47-2e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:51 user nova-compute[71269]: INFO os_vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c18cfc-0a09-4c0d-bcf3-0c5b21db0aed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:56:51 user nova-compute[71269]: No targets found.
Apr 13 22:56:51 user nova-compute[71269]: iSNS:
Apr 13 22:56:51 user nova-compute[71269]: No targets found.
Apr 13 22:56:51 user nova-compute[71269]: STATIC:
Apr 13 22:56:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:56:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:56:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:56:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:56:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:56:51 user nova-compute[71269]: FIRMWARE:
Apr 13 22:56:51 user nova-compute[71269]: No targets found.
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:56:51 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:56:51 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d56b06-46b0-4261-9261-23bccaf286ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0994373-bc7c-4540-b04c-5a97d9588636]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb31c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fbbd43-7d3e-496b-a073-6e87e0d56d23]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[932fe301-f8c4-48be-a081-8709ef19dffd]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0fe45-3cc8-4869-aca7-7bc628782e86]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ad1290-1011-4e46-9e78-ec88493bb164]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bc92e5-a5a5-46dc-a1d4-23d1ba0111c3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b38b19-928b-4f76-ad5d-12abaca93578]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]
Apr 13 22:56:51 user nova-compute[71269]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b9a14-5b5c-4040-ad63-1123ed8db533]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== disconnect_volume: return (306ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start _get_guest_xml network_info=[{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '3c2fe143-1ebf-4424-a954-47c5482950f5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '92e1fa88-8896-4198-af4d-56d44baf3b9b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a58090c7-ce32-4a3f-a2f0-f327259775e7', 'serial': 'a58090c7-ce32-4a3f-a2f0-f327259775e7'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'numa_topology' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:56:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:56:51 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21cd90-65ed-4c7a-9471-7c15f046da4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:56:51 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5f36a9-1cc5-4d59-9b63-a451a67b910c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7] added
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2205b21-9552-4a32-b6d1-c5b0ad2b7eb0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba072d1-38a8-400e-86c0-87ad1ef894a8]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKIysTWU {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKIysTWU" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d710b29-4565-49ad-920d-0a99fcfb76e5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lKIysTWU'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db16e6-dc69-48fa-95e6-da2c1695d8d3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ad82d-61ab-45b0-9bec-c5b21789be6d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee928da6-2a07-49bb-badb-4b9930812b34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]
Apr 13 22:56:51 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c4b4b-5fdc-4844-97dd-15b2eba7203f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a803941-532e-4e8a-a798-2605678fea82]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:56:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:56:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c17795-2311-45d8-abdf-000f6659e22b]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:56:52 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:56:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26235636263353739', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235636263353739', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:56:53 user nova-compute[71269]:   <uuid>92e1fa88-8896-4198-af4d-56d44baf3b9b</uuid>
Apr 13 22:56:53 user nova-compute[71269]:   <name>instance-00000003</name>
Apr 13 22:56:53 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:56:53 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:56:53 user nova-compute[71269]:   <metadata>
Apr 13 22:56:53 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:56:53 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeTestJSON-server-399970293</nova:name>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:56:51</nova:creationTime>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:56:53 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:56:53 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:owner>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:user uuid="13b46af525dd45678b69207e93683ac4">tempest-AttachVolumeTestJSON-118072319-project-member</nova:user>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:project uuid="d0648ea953174a8cae6085ac24d92bb1">tempest-AttachVolumeTestJSON-118072319</nova:project>
Apr 13 22:56:53 user nova-compute[71269]:       </nova:owner>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:56:53 user nova-compute[71269]:       <nova:ports>
Apr 13 22:56:53 user nova-compute[71269]:         <nova:port uuid="94c47f47-2ee7-46d0-858d-a5ff3270a80b">
Apr 13 22:56:53 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:56:53 user nova-compute[71269]:         </nova:port>
Apr 13 22:56:53 user nova-compute[71269]:       </nova:ports>
Apr 13 22:56:53 user nova-compute[71269]:     </nova:instance>
Apr 13 22:56:53 user nova-compute[71269]:   </metadata>
Apr 13 22:56:53 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:56:53 user nova-compute[71269]:     <system>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="serial">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="uuid">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 22:56:53 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:56:53 user nova-compute[71269]:     </system>
Apr 13 22:56:53 user nova-compute[71269]:   </sysinfo>
Apr 13 22:56:53 user nova-compute[71269]:   <os>
Apr 13 22:56:53 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:56:53 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:56:53 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:56:53 user nova-compute[71269]:   </os>
Apr 13 22:56:53 user nova-compute[71269]:   <features>
Apr 13 22:56:53 user nova-compute[71269]:     <acpi/>
Apr 13 22:56:53 user nova-compute[71269]:     <apic/>
Apr 13 22:56:53 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:56:53 user nova-compute[71269]:   </features>
Apr 13 22:56:53 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:56:53 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:56:53 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:56:53 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:56:53 user nova-compute[71269]:   </clock>
Apr 13 22:56:53 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:56:53 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:56:53 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:56:53 user nova-compute[71269]:   </cpu>
Apr 13 22:56:53 user nova-compute[71269]:   <devices>
Apr 13 22:56:53 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:53 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:53 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk"/>
Apr 13 22:56:53 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:56:53 user nova-compute[71269]:     </disk>
Apr 13 22:56:53 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:56:53 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:56:53 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 22:56:53 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:56:53 user nova-compute[71269]:       <serial>a58090c7-ce32-4a3f-a2f0-f327259775e7</serial>
Apr 13 22:56:53 user nova-compute[71269]:     </disk>
Apr 13 22:56:53 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:56:53 user nova-compute[71269]:       <mac address="fa:16:3e:03:14:a3"/>
Apr 13 22:56:53 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:53 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:56:53 user nova-compute[71269]:       <target dev="tap94c47f47-2e"/>
Apr 13 22:56:53 user nova-compute[71269]:     </interface>
Apr 13 22:56:53 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:56:53 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/console.log" append="off"/>
Apr 13 22:56:53 user nova-compute[71269]:     </serial>
Apr 13 22:56:53 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:56:53 user nova-compute[71269]:     <video>
Apr 13 22:56:53 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:53 user nova-compute[71269]:     </video>
Apr 13 22:56:53 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:56:53 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:56:53 user nova-compute[71269]:     </rng>
Apr 13 22:56:53 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:56:53 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:56:53 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:56:53 user nova-compute[71269]:     </memballoon>
Apr 13 22:56:53 user nova-compute[71269]:   </devices>
Apr 13 22:56:53 user nova-compute[71269]: </domain>
Apr 13 22:56:53 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.178s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Cannot resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'migration_context' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG os_vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c47f47-2e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c47f47-2e, col_values=(('external_ids', {'iface-id': '94c47f47-2ee7-46d0-858d-a5ff3270a80b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:14:a3', 'vm-uuid': '92e1fa88-8896-4198-af4d-56d44baf3b9b'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:53 user nova-compute[71269]: INFO os_vif [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 22:56:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:56:54 user nova-compute[71269]: INFO nova.compute.claims [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Claim successful on node user
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:56:54 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:56:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:56:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Creating image(s)
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.policy [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:55 user nova-compute[71269]: WARNING nova.compute.manager [req-da708548-e4dd-4f5e-ad23-9ab9ba58ba15 req-12377bef-b76e-4c55-9094-e0408d9a77d7 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state powering-on.
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.virt.images [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] bd4ff522-0822-422c-8f3d-ad6afaa48909 was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.part /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426600.82064, 3d246d08-7efe-4307-8a37-32f4c0621128 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:55 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] VM Stopped (Lifecycle Event)
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.part /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.converted" returned: 0 in 0.198s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-762048d5-7984-44dd-97a0-8db233e54b1a None None] [instance: 3d246d08-7efe-4307-8a37-32f4c0621128] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.907s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358,backing_fmt=raw /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358,backing_fmt=raw /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk 1073741824" returned: 0 in 0.063s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "ba2f6ab5c991162cda6e923ff37e1f57e3262358" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Successfully created port: 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Cannot resize image /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'migration_context' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Ensure instance console log exists: /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Successfully updated port: 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing instance network info cache due to event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426617.4869032, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:57 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Resumed (Lifecycle Event)
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance rebooted successfully.
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-a990e563-a5e3-4bb1-a830-e138576bb18e tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance network_info: |[{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.neutron [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start _get_guest_xml network_info=[{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:56:51Z,direct_url=<?>,disk_format='qcow2',id=bd4ff522-0822-422c-8f3d-ad6afaa48909,min_disk=0,min_ram=0,name='tempest-scenario-img--1850187553',owner='cf532d1c87a34b8cbde0f162688f7cdb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:56:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'bd4ff522-0822-422c-8f3d-ad6afaa48909'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:56:57 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426617.4901948, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:56:57 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Started (Lifecycle Event)
Apr 13 22:56:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:56:51Z,direct_url=<?>,disk_format='qcow2',id=bd4ff522-0822-422c-8f3d-ad6afaa48909,min_disk=0,min_ram=0,name='tempest-scenario-img--1850187553',owner='cf532d1c87a34b8cbde0f162688f7cdb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:56:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:55Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'pci_devices' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:57 user nova-compute[71269]: WARNING nova.compute.manager [req-95a90624-46e0-4af6-be96-e607c33ca9a3 req-76d7e629-e4a4-40a5-bf2c-d840a2a891d5 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state powering-on.
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:56:57 user nova-compute[71269]:   <uuid>b190941d-9f62-41ef-881d-e02d246e9138</uuid>
Apr 13 22:56:57 user nova-compute[71269]:   <name>instance-0000000e</name>
Apr 13 22:56:57 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:56:57 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:56:57 user nova-compute[71269]:   <metadata>
Apr 13 22:56:57 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:56:57 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:name>tempest-TestMinimumBasicScenario-server-1582878166</nova:name>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:56:57</nova:creationTime>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:56:57 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:56:57 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:owner>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:user uuid="fad76e3a6e154feaa62d95f6e7d1ce1c">tempest-TestMinimumBasicScenario-146514025-project-member</nova:user>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:project uuid="cf532d1c87a34b8cbde0f162688f7cdb">tempest-TestMinimumBasicScenario-146514025</nova:project>
Apr 13 22:56:57 user nova-compute[71269]:       </nova:owner>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:root type="image" uuid="bd4ff522-0822-422c-8f3d-ad6afaa48909"/>
Apr 13 22:56:57 user nova-compute[71269]:       <nova:ports>
Apr 13 22:56:57 user nova-compute[71269]:         <nova:port uuid="37865aaf-d7fb-4f6b-b764-2b75e9d3e924">
Apr 13 22:56:57 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 22:56:57 user nova-compute[71269]:         </nova:port>
Apr 13 22:56:57 user nova-compute[71269]:       </nova:ports>
Apr 13 22:56:57 user nova-compute[71269]:     </nova:instance>
Apr 13 22:56:57 user nova-compute[71269]:   </metadata>
Apr 13 22:56:57 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:56:57 user nova-compute[71269]:     <system>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="serial">b190941d-9f62-41ef-881d-e02d246e9138</entry>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="uuid">b190941d-9f62-41ef-881d-e02d246e9138</entry>
Apr 13 22:56:57 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:56:57 user nova-compute[71269]:     </system>
Apr 13 22:56:57 user nova-compute[71269]:   </sysinfo>
Apr 13 22:56:57 user nova-compute[71269]:   <os>
Apr 13 22:56:57 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:56:57 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:56:57 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:56:57 user nova-compute[71269]:   </os>
Apr 13 22:56:57 user nova-compute[71269]:   <features>
Apr 13 22:56:57 user nova-compute[71269]:     <acpi/>
Apr 13 22:56:57 user nova-compute[71269]:     <apic/>
Apr 13 22:56:57 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:56:57 user nova-compute[71269]:   </features>
Apr 13 22:56:57 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:56:57 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:56:57 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:56:57 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:56:57 user nova-compute[71269]:   </clock>
Apr 13 22:56:57 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:56:57 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:56:57 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:56:57 user nova-compute[71269]:   </cpu>
Apr 13 22:56:57 user nova-compute[71269]:   <devices>
Apr 13 22:56:57 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:56:57 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:56:57 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk"/>
Apr 13 22:56:57 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:56:57 user nova-compute[71269]:     </disk>
Apr 13 22:56:57 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:56:57 user nova-compute[71269]:       <mac address="fa:16:3e:f9:25:e8"/>
Apr 13 22:56:57 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:57 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:56:57 user nova-compute[71269]:       <target dev="tap37865aaf-d7"/>
Apr 13 22:56:57 user nova-compute[71269]:     </interface>
Apr 13 22:56:57 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:56:57 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/console.log" append="off"/>
Apr 13 22:56:57 user nova-compute[71269]:     </serial>
Apr 13 22:56:57 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:56:57 user nova-compute[71269]:     <video>
Apr 13 22:56:57 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:56:57 user nova-compute[71269]:     </video>
Apr 13 22:56:57 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:56:57 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:56:57 user nova-compute[71269]:     </rng>
Apr 13 22:56:57 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:56:57 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:56:57 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:56:57 user nova-compute[71269]:     </memballoon>
Apr 13 22:56:57 user nova-compute[71269]:   </devices>
Apr 13 22:56:57 user nova-compute[71269]: </domain>
Apr 13 22:56:57 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:56:55Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG os_vif [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37865aaf-d7, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37865aaf-d7, col_values=(('external_ids', {'iface-id': '37865aaf-d7fb-4f6b-b764-2b75e9d3e924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:25:e8', 'vm-uuid': 'b190941d-9f62-41ef-881d-e02d246e9138'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:57 user nova-compute[71269]: INFO os_vif [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7')
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:56:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No VIF found with MAC fa:16:3e:f9:25:e8, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updated VIF entry in instance network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8de9cb61-ace5-4f4c-8c30-c013249f3298 req-72af72b5-9d16-4743-8915-3bb1b18f9ec4 service nova] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-changed-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Refreshing instance network info cache due to event network-changed-38a15311-5617-41cd-83a3-b253ee45f5d8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Acquiring lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Acquired lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Refreshing network info cache for port 38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:58 user nova-compute[71269]: INFO nova.compute.manager [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Terminating instance
Apr 13 22:56:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updated VIF entry in instance network info cache for port 38a15311-5617-41cd-83a3-b253ee45f5d8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updating instance_info_cache with network_info: [{"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-05d5c704-ca8f-41c0-8ec3-8d8b13e0285d req-d82e6753-a64f-4879-b319-703520bd673d service nova] Releasing lock "refresh_cache-74b32176-d23e-41cb-80b2-5e8eede9ba7f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-unplugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] No waiting events found dispatching network-vif-unplugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-95a2976f-9d11-4e61-8ea0-ee81ae13daba req-8b0b324a-329f-4fe9-9180-aa27337c4b21 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-unplugged-38a15311-5617-41cd-83a3-b253ee45f5d8 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:56:59 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Instance destroyed successfully.
Apr 13 22:56:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'resources' on Instance uuid 74b32176-d23e-41cb-80b2-5e8eede9ba7f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-327963572',display_name='tempest-AttachVolumeNegativeTest-server-327963572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-327963572',id=11,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/fIOmV2oYNa5X2ielk8jHAzzKZDAmddNM9O0Vg4iA3cFAMMTj3Mu0r6iY22xgj5uoQiV5bWcCQVTWzxrknDJXU2Fxq/BhxckivvclzEiTgSKiPMw1SKzeL/rXorxQvTA==',key_name='tempest-keypair-1770675987',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:55:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-v45unmx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=74b32176-d23e-41cb-80b2-5e8eede9ba7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "38a15311-5617-41cd-83a3-b253ee45f5d8", "address": "fa:16:3e:a9:c1:97", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a15311-56", "ovs_interfaceid": "38a15311-5617-41cd-83a3-b253ee45f5d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG os_vif [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a15311-56, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:00 user nova-compute[71269]: INFO os_vif [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=38a15311-5617-41cd-83a3-b253ee45f5d8,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a15311-56')
Apr 13 22:57:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Deleting instance files /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f_del
Apr 13 22:57:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Deletion of /opt/stack/data/nova/instances/74b32176-d23e-41cb-80b2-5e8eede9ba7f_del complete
Apr 13 22:57:00 user nova-compute[71269]: INFO nova.compute.manager [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:00 user nova-compute[71269]: WARNING nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state building and task_state spawning.
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:00 user nova-compute[71269]: WARNING nova.compute.manager [req-7c58e986-ede2-437f-b5ea-ec3e43d42248 req-11b4467d-616b-4080-9833-7c72180b7ca0 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state building and task_state spawning.
Apr 13 22:57:00 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:57:00 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Took 0.77 seconds to deallocate network for instance.
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:01 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Deleted allocations for instance 74b32176-d23e-41cb-80b2-5e8eede9ba7f
Apr 13 22:57:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Acquiring lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] No waiting events found dispatching network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:01 user nova-compute[71269]: WARNING nova.compute.manager [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received unexpected event network-vif-plugged-38a15311-5617-41cd-83a3-b253ee45f5d8 for instance with vm_state deleted and task_state None.
Apr 13 22:57:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c62df06-099e-43b0-87f8-b1d47959b336 req-3d7516f5-a164-4376-a58d-e3dcebb563c7 service nova] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Received event network-vif-deleted-38a15311-5617-41cd-83a3-b253ee45f5d8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-28381680-c552-44db-a8a1-3188da61ff72 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "74b32176-d23e-41cb-80b2-5e8eede9ba7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426622.1507385, b190941d-9f62-41ef-881d-e02d246e9138 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] VM Resumed (Lifecycle Event)
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance spawned successfully.
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426622.1522436, b190941d-9f62-41ef-881d-e02d246e9138 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] VM Started (Lifecycle Event)
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Took 7.19 seconds to spawn the instance on the hypervisor.
Apr 13 22:57:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:57:02 user nova-compute[71269]: INFO nova.compute.manager [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Took 8.00 seconds to build instance.
Apr 13 22:57:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5010db84-0787-4f49-b096-f7e6d6a60b74 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.123s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:57:03 user nova-compute[71269]: INFO nova.compute.claims [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Claim successful on node user
Apr 13 22:57:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:57:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:57:03 user nova-compute[71269]: INFO nova.virt.block_device [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Booting with volume ca6e2122-7182-409a-ac67-4361de1d68a1 at /dev/vda
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.policy [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1684675c-7c64-46ea-8af3-18b43eab8e9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6ff96-5cab-46dd-9fda-46dfc25bed13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fe590e-1e1c-401f-9d19-f9caa6b59b47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce100863-f54f-4aeb-a7a8-0e885697edcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:57:03 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:57:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b21b9-fe8e-4216-91b5-b6686e660431]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:57:03 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updating existing volume attachment record: 9421354a-b17b-4800-b44a-8a6aaf6172c9 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:57:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Successfully created port: b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Successfully updated port: b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-changed-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Refreshing instance network info cache due to event network-changed-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Acquiring lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updating instance_info_cache with network_info: [{"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Instance network_info: |[{"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Acquired lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Refreshing network info cache for port b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updated VIF entry in instance network info cache for port b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updating instance_info_cache with network_info: [{"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:57:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ec9fa3b-9b31-4162-931a-112a1953f002 req-c10aafe4-f90c-43bf-a06e-da010f17d9c0 service nova] Releasing lock "refresh_cache-05c9ae9c-47df-41c7-8805-f6fe22bf09d6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:57:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Creating image(s)
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Ensure instance console log exists: /opt/stack/data/nova/instances/05c9ae9c-47df-41c7-8805-f6fe22bf09d6/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Start _get_guest_xml network_info=[{"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '9421354a-b17b-4800-b44a-8a6aaf6172c9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQPCjqrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05c9ae9c-47df-41c7-8805-f6fe22bf09d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca6e2122-7182-409a-ac67-4361de1d68a1', 'serial': 'ca6e2122-7182-409a-ac67-4361de1d68a1'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:57:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQPCjqrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:57:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:57:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:57:08 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee62fb-cd31-4195-a7a1-c55eb132e193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:57:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a03dfdc-c9be-43f2-81a7-9f17941f54f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1] added
Apr 13 22:57:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[00826bbf-1ab7-40a9-8871-9a1ca12652a7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce224670-52b3-4ebb-a361-061ba70e70e2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQPCjqrY {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQPCjqrY" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e813c2-f167-4ea1-8774-3590a4196a18]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQPCjqrY'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48cba2-1959-4016-9f7b-0bc73e0c4472]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e3eb8-bd52-49d8-ba2d-bfcc029564d4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f2e66b-c053-466b-8062-55af78cd5115]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260]
Apr 13 22:57:08 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260] successful.
Apr 13 22:57:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c8eee-6c01-4ddb-8f51-4ab2fef1d3cc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b868ec-5087-42d5-90d6-a3b04f3f0635]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdaa562-580c-4975-a725-e50cb35f845e]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQPCjqrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23336376233386166', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336376233386166', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1413427865',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-ftvmgczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:57:04Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=05c9ae9c-47df-41c7-8805-f6fe22bf09d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:57:10 user nova-compute[71269]:   <uuid>05c9ae9c-47df-41c7-8805-f6fe22bf09d6</uuid>
Apr 13 22:57:10 user nova-compute[71269]:   <name>instance-0000000f</name>
Apr 13 22:57:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:57:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:57:10 user nova-compute[71269]:   <metadata>
Apr 13 22:57:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:57:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:57:10 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1413427865</nova:name>
Apr 13 22:57:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:57:08</nova:creationTime>
Apr 13 22:57:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:57:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:57:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:57:10 user nova-compute[71269]:       <nova:owner>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 22:57:10 user nova-compute[71269]:       </nova:owner>
Apr 13 22:57:10 user nova-compute[71269]:       <nova:ports>
Apr 13 22:57:10 user nova-compute[71269]:         <nova:port uuid="b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c">
Apr 13 22:57:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:57:10 user nova-compute[71269]:         </nova:port>
Apr 13 22:57:10 user nova-compute[71269]:       </nova:ports>
Apr 13 22:57:10 user nova-compute[71269]:     </nova:instance>
Apr 13 22:57:10 user nova-compute[71269]:   </metadata>
Apr 13 22:57:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:57:10 user nova-compute[71269]:     <system>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="serial">05c9ae9c-47df-41c7-8805-f6fe22bf09d6</entry>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="uuid">05c9ae9c-47df-41c7-8805-f6fe22bf09d6</entry>
Apr 13 22:57:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:57:10 user nova-compute[71269]:     </system>
Apr 13 22:57:10 user nova-compute[71269]:   </sysinfo>
Apr 13 22:57:10 user nova-compute[71269]:   <os>
Apr 13 22:57:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:57:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:57:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:57:10 user nova-compute[71269]:   </os>
Apr 13 22:57:10 user nova-compute[71269]:   <features>
Apr 13 22:57:10 user nova-compute[71269]:     <acpi/>
Apr 13 22:57:10 user nova-compute[71269]:     <apic/>
Apr 13 22:57:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:57:10 user nova-compute[71269]:   </features>
Apr 13 22:57:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:57:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:57:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:57:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:57:10 user nova-compute[71269]:   </clock>
Apr 13 22:57:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:57:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:57:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:57:10 user nova-compute[71269]:   </cpu>
Apr 13 22:57:10 user nova-compute[71269]:   <devices>
Apr 13 22:57:10 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:57:10 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:57:10 user nova-compute[71269]:       <source dev="/dev/sde"/>
Apr 13 22:57:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:57:10 user nova-compute[71269]:       <serial>ca6e2122-7182-409a-ac67-4361de1d68a1</serial>
Apr 13 22:57:10 user nova-compute[71269]:     </disk>
Apr 13 22:57:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:57:10 user nova-compute[71269]:       <mac address="fa:16:3e:92:14:9a"/>
Apr 13 22:57:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:57:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:57:10 user nova-compute[71269]:       <target dev="tapb7b60d2d-f4"/>
Apr 13 22:57:10 user nova-compute[71269]:     </interface>
Apr 13 22:57:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:57:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/05c9ae9c-47df-41c7-8805-f6fe22bf09d6/console.log" append="off"/>
Apr 13 22:57:10 user nova-compute[71269]:     </serial>
Apr 13 22:57:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:57:10 user nova-compute[71269]:     <video>
Apr 13 22:57:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:57:10 user nova-compute[71269]:     </video>
Apr 13 22:57:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:57:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:57:10 user nova-compute[71269]:     </rng>
Apr 13 22:57:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:57:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:57:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:57:10 user nova-compute[71269]:     </memballoon>
Apr 13 22:57:10 user nova-compute[71269]:   </devices>
Apr 13 22:57:10 user nova-compute[71269]: </domain>
Apr 13 22:57:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1413427865',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-ftvmgczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:57:04Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=05c9ae9c-47df-41c7-8805-f6fe22bf09d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG os_vif [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b60d2d-f4, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7b60d2d-f4, col_values=(('external_ids', {'iface-id': 'b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:14:9a', 'vm-uuid': '05c9ae9c-47df-41c7-8805-f6fe22bf09d6'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:10 user nova-compute[71269]: INFO os_vif [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4')
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:57:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:92:14:9a, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] No waiting events found dispatching network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:11 user nova-compute[71269]: WARNING nova.compute.manager [req-c6ca3a12-3e06-474b-b41f-50a00fc902da req-4ecb8273-e6bf-4e88-973d-38c970830982 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received unexpected event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance with vm_state building and task_state spawning.
Apr 13 22:57:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] No waiting events found dispatching network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:13 user nova-compute[71269]: WARNING nova.compute.manager [req-14704881-1a71-4912-aa79-9130cb455106 req-2d620a16-ffac-4c31-9962-da0cb3c63309 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received unexpected event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance with vm_state building and task_state spawning.
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426633.759547, 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] VM Resumed (Lifecycle Event)
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Instance spawned successfully.
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426633.7615855, 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] VM Started (Lifecycle Event)
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 13 22:57:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:13 user nova-compute[71269]: INFO nova.compute.manager [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Took 10.82 seconds to build instance.
Apr 13 22:57:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-46cc87f4-1c5a-448a-ac01-0c5a62a50f8a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.948s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:14 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426619.9733908, 74b32176-d23e-41cb-80b2-5e8eede9ba7f => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:14 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] VM Stopped (Lifecycle Event)
Apr 13 22:57:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9cb94791-514d-498a-981c-c9d5b3655c6f None None] [instance: 74b32176-d23e-41cb-80b2-5e8eede9ba7f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:42 user nova-compute[71269]: INFO nova.compute.manager [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Rescuing
Apr 13 22:57:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:57:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:57:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG nova.network.neutron [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:43 user nova-compute[71269]: WARNING nova.compute.manager [req-98f788f8-3c8e-4ccf-9dfd-57e10a4b4318 req-bd478382-e0f5-43ca-aed9-cf56521027cc service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state active and task_state rescuing.
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:43 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance destroyed successfully.
Apr 13 22:57:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Attempting rescue
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 22:57:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Creating image(s)
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'trusted_certs' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.229s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start _get_guest_xml network_info=[{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:05:19:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'numa_topology' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'vcpu_model' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442957850',display_name='tempest-ServerRescueNegativeTestJSON-server-1442957850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442957850',id=4,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-40rn7keu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:53:12Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=df12dd8d-ea02-4c59-804d-52ae1bd4a555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:05:19:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:05:19:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:57:44 user nova-compute[71269]:   <uuid>df12dd8d-ea02-4c59-804d-52ae1bd4a555</uuid>
Apr 13 22:57:44 user nova-compute[71269]:   <name>instance-00000004</name>
Apr 13 22:57:44 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:57:44 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:57:44 user nova-compute[71269]:   <metadata>
Apr 13 22:57:44 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:57:44 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1442957850</nova:name>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:57:44</nova:creationTime>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:57:44 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:57:44 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:owner>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 22:57:44 user nova-compute[71269]:       </nova:owner>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:57:44 user nova-compute[71269]:       <nova:ports>
Apr 13 22:57:44 user nova-compute[71269]:         <nova:port uuid="6566345e-be68-4eb1-90de-e53780e7f8f9">
Apr 13 22:57:44 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 22:57:44 user nova-compute[71269]:         </nova:port>
Apr 13 22:57:44 user nova-compute[71269]:       </nova:ports>
Apr 13 22:57:44 user nova-compute[71269]:     </nova:instance>
Apr 13 22:57:44 user nova-compute[71269]:   </metadata>
Apr 13 22:57:44 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:57:44 user nova-compute[71269]:     <system>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="serial">df12dd8d-ea02-4c59-804d-52ae1bd4a555</entry>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="uuid">df12dd8d-ea02-4c59-804d-52ae1bd4a555</entry>
Apr 13 22:57:44 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:57:44 user nova-compute[71269]:     </system>
Apr 13 22:57:44 user nova-compute[71269]:   </sysinfo>
Apr 13 22:57:44 user nova-compute[71269]:   <os>
Apr 13 22:57:44 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:57:44 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:57:44 user nova-compute[71269]:   </os>
Apr 13 22:57:44 user nova-compute[71269]:   <features>
Apr 13 22:57:44 user nova-compute[71269]:     <acpi/>
Apr 13 22:57:44 user nova-compute[71269]:     <apic/>
Apr 13 22:57:44 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:57:44 user nova-compute[71269]:   </features>
Apr 13 22:57:44 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:57:44 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:57:44 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:57:44 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:57:44 user nova-compute[71269]:   </clock>
Apr 13 22:57:44 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:57:44 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:57:44 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:57:44 user nova-compute[71269]:   </cpu>
Apr 13 22:57:44 user nova-compute[71269]:   <devices>
Apr 13 22:57:44 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:57:44 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:57:44 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue"/>
Apr 13 22:57:44 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:57:44 user nova-compute[71269]:     </disk>
Apr 13 22:57:44 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:57:44 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:57:44 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk"/>
Apr 13 22:57:44 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:57:44 user nova-compute[71269]:     </disk>
Apr 13 22:57:44 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:57:44 user nova-compute[71269]:       <mac address="fa:16:3e:05:19:3f"/>
Apr 13 22:57:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:57:44 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:57:44 user nova-compute[71269]:       <target dev="tap6566345e-be"/>
Apr 13 22:57:44 user nova-compute[71269]:     </interface>
Apr 13 22:57:44 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:57:44 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/console.log" append="off"/>
Apr 13 22:57:44 user nova-compute[71269]:     </serial>
Apr 13 22:57:44 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:57:44 user nova-compute[71269]:     <video>
Apr 13 22:57:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:57:44 user nova-compute[71269]:     </video>
Apr 13 22:57:44 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:57:44 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:57:44 user nova-compute[71269]:     </rng>
Apr 13 22:57:44 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:57:44 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:57:44 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:57:44 user nova-compute[71269]:     </memballoon>
Apr 13 22:57:44 user nova-compute[71269]:   </devices>
Apr 13 22:57:44 user nova-compute[71269]: </domain>
Apr 13 22:57:44 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:57:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance destroyed successfully.
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:05:19:3f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:45 user nova-compute[71269]: WARNING nova.compute.manager [req-fe05854d-9159-4ac5-9ca4-c7addb175bbb req-9da27258-2a2e-4d41-8c37-24c1bc6fd3c9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state active and task_state rescuing.
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:47 user nova-compute[71269]: WARNING nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state active and task_state rescuing.
Apr 13 22:57:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:57:47 user nova-compute[71269]: WARNING nova.compute.manager [req-4130c6f4-24c6-45ae-a809-1d3eacf1e05c req-e594d779-e59d-49d2-9876-5f1b36d68dd9 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state active and task_state rescuing.
Apr 13 22:57:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for df12dd8d-ea02-4c59-804d-52ae1bd4a555 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426668.5285046, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Resumed (Lifecycle Event)
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-af5011a1-a463-4649-94f1-20062c01a426 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=26.391353607177734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426668.5294967, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:57:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Started (Lifecycle Event)
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:57:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance c10b97ca-3231-41fe-9de5-03cd6dc81e07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b190941d-9f62-41ef-881d-e02d246e9138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:57:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:57:50 user nova-compute[71269]: INFO nova.compute.manager [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Detaching volume 098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:57:50 user nova-compute[71269]: INFO nova.virt.block_device [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Attempting to driver detach volume 098aedca-2822-4384-bff5-58cccb0f96a0 from mountpoint /dev/vdb
Apr 13 22:57:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Attempting to detach device vdb from instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:57:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:57:50 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:57:50 user nova-compute[71269]:   <source dev="/dev/sdd"/>
Apr 13 22:57:50 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:57:50 user nova-compute[71269]:   <serial>098aedca-2822-4384-bff5-58cccb0f96a0</serial>
Apr 13 22:57:50 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:57:50 user nova-compute[71269]: </disk>
Apr 13 22:57:50 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:57:50 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 from the persistent domain config.
Apr 13 22:57:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:57:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:57:50 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:57:50 user nova-compute[71269]:   <source dev="/dev/sdd"/>
Apr 13 22:57:50 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:57:50 user nova-compute[71269]:   <serial>098aedca-2822-4384-bff5-58cccb0f96a0</serial>
Apr 13 22:57:50 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:57:50 user nova-compute[71269]: </disk>
Apr 13 22:57:50 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426671.4733434, 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:57:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 from the live domain config.
Apr 13 22:57:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCpXrfEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:57:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da51094-c7f2-4e3c-b15c-daaf4d85d399]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:57:51 user nova-compute[71269]: No targets found.
Apr 13 22:57:51 user nova-compute[71269]: iSNS:
Apr 13 22:57:51 user nova-compute[71269]: No targets found.
Apr 13 22:57:51 user nova-compute[71269]: STATIC:
Apr 13 22:57:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0
Apr 13 22:57:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:57:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:57:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 22:57:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:57:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:57:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:57:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:57:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:57:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:57:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:57:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:57:51 user nova-compute[71269]: FIRMWARE:
Apr 13 22:57:51 user nova-compute[71269]: No targets found.
Apr 13 22:57:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:57:51 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:57:51 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ff458-5d95-4588-955c-41b122fd03f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b774cfb-c28b-4c4f-ba9d-c99b7c27cb9f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 (non-flash)
Apr 13 22:57:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc38bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0'): ({'sdd'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Removing single pathed devices sdd {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[07619646-3e5d-4a65-ae68-d2c07cbf8c9c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a351b4a2-48b7-41e0-bf51-065a3e4c1683]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flushing IO for device /dev/sdd {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd6d6c-c7d6-40c3-8c02-b6892403594b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d9ddc-e8e9-4e07-8a63-66c0438b5c75]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] SCSI volumes sdd have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ce5db-7754-4404-8b4e-c8dd6cfc59dc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48dd40-c5d7-4da1-abfb-1ec132c2df28]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260]
Apr 13 22:57:51 user nova-compute[71269]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0, portal: 172.16.0.220,3260] successful.
Apr 13 22:57:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:098aedca-2822-4384-bff5-58cccb0f96a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb99f41-3be5-4a02-b608-6a3472cd4f5c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== disconnect_volume: return (336ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:57:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:57:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3873414d-2ca8-4c2b-af73-e55b88f46ea9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.135s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:57:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:57:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:04 user nova-compute[71269]: INFO nova.compute.manager [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Terminating instance
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d1b932c-b968-4d1c-929c-501c6a8d1107 req-9a03d4b7-128b-4f12-be2c-9bbfb4fc651a service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Instance destroyed successfully.
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'resources' on Instance uuid c10b97ca-3231-41fe-9de5-03cd6dc81e07 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632020151',display_name='tempest-VolumesAdminNegativeTest-server-1632020151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632020151',id=12,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-9dop6icl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:56:15Z,user_data=None,user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=c10b97ca-3231-41fe-9de5-03cd6dc81e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "address": "fa:16:3e:87:0e:6c", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c122f3-f4", "ovs_interfaceid": "d8c122f3-f485-406e-87b1-c547eabd5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG os_vif [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c122f3-f4, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: INFO os_vif [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:6c,bridge_name='br-int',has_traffic_filtering=True,id=d8c122f3-f485-406e-87b1-c547eabd5bf3,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c122f3-f4')
Apr 13 22:58:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Deleting instance files /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07_del
Apr 13 22:58:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Deletion of /opt/stack/data/nova/instances/c10b97ca-3231-41fe-9de5-03cd6dc81e07_del complete
Apr 13 22:58:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:04 user nova-compute[71269]: INFO nova.compute.manager [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 22:58:04 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:58:04 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:58:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:06 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Took 1.14 seconds to deallocate network for instance.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-dad0d764-4472-489c-94df-962bafb3722f req-333a9dff-ee4c-482b-af0a-dbf6130184fe service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-deleted-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Deleted allocations for instance c10b97ca-3231-41fe-9de5-03cd6dc81e07
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:06 user nova-compute[71269]: WARNING nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state deleted and task_state None.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:06 user nova-compute[71269]: WARNING nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state deleted and task_state None.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:06 user nova-compute[71269]: WARNING nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state deleted and task_state None.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:06 user nova-compute[71269]: WARNING nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-unplugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state deleted and task_state None.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Acquiring lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] No waiting events found dispatching network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:06 user nova-compute[71269]: WARNING nova.compute.manager [req-a0b06eb4-656e-4ed4-ad09-79bbfb1505f9 req-25d0293b-2b2a-4b47-ad9a-a256e62bec3f service nova] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Received unexpected event network-vif-plugged-d8c122f3-f485-406e-87b1-c547eabd5bf3 for instance with vm_state deleted and task_state None.
Apr 13 22:58:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6b5c7513-6668-46ae-88de-3bd7ab9a87f7 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "c10b97ca-3231-41fe-9de5-03cd6dc81e07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:58:07 user nova-compute[71269]: INFO nova.compute.claims [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Claim successful on node user
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:58:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:58:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.policy [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:58:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Creating image(s)
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk 1073741824" returned: 0 in 0.048s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Successfully created port: ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Cannot resize image /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'migration_context' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Ensure instance console log exists: /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Successfully updated port: ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-changed-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing instance network info cache due to event network-changed-ffc806fb-1b25-492f-b786-27222f795160. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Instance network_info: |[{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.neutron [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing network info cache for port ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Start _get_guest_xml network_info=[{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:58:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:58:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:58:09 user nova-compute[71269]:   <uuid>3f6a020c-d8b5-4f6b-a3f0-38287111153a</uuid>
Apr 13 22:58:09 user nova-compute[71269]:   <name>instance-00000010</name>
Apr 13 22:58:09 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:58:09 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:58:09 user nova-compute[71269]:   <metadata>
Apr 13 22:58:09 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:58:09 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:58:09</nova:creationTime>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:58:09 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:58:09 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:owner>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 22:58:09 user nova-compute[71269]:       </nova:owner>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:58:09 user nova-compute[71269]:       <nova:ports>
Apr 13 22:58:09 user nova-compute[71269]:         <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 22:58:09 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 22:58:09 user nova-compute[71269]:         </nova:port>
Apr 13 22:58:09 user nova-compute[71269]:       </nova:ports>
Apr 13 22:58:09 user nova-compute[71269]:     </nova:instance>
Apr 13 22:58:09 user nova-compute[71269]:   </metadata>
Apr 13 22:58:09 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:58:09 user nova-compute[71269]:     <system>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="serial">3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="uuid">3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 22:58:09 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:58:09 user nova-compute[71269]:     </system>
Apr 13 22:58:09 user nova-compute[71269]:   </sysinfo>
Apr 13 22:58:09 user nova-compute[71269]:   <os>
Apr 13 22:58:09 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:58:09 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:58:09 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:58:09 user nova-compute[71269]:   </os>
Apr 13 22:58:09 user nova-compute[71269]:   <features>
Apr 13 22:58:09 user nova-compute[71269]:     <acpi/>
Apr 13 22:58:09 user nova-compute[71269]:     <apic/>
Apr 13 22:58:09 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:58:09 user nova-compute[71269]:   </features>
Apr 13 22:58:09 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:58:09 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:58:09 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:58:09 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:58:09 user nova-compute[71269]:   </clock>
Apr 13 22:58:09 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:58:09 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:58:09 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:58:09 user nova-compute[71269]:   </cpu>
Apr 13 22:58:09 user nova-compute[71269]:   <devices>
Apr 13 22:58:09 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:58:09 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:58:09 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk"/>
Apr 13 22:58:09 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:58:09 user nova-compute[71269]:     </disk>
Apr 13 22:58:09 user nova-compute[71269]:     <disk type="file" device="cdrom">
Apr 13 22:58:09 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 22:58:09 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config"/>
Apr 13 22:58:09 user nova-compute[71269]:       <target dev="hda" bus="ide"/>
Apr 13 22:58:09 user nova-compute[71269]:     </disk>
Apr 13 22:58:09 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:58:09 user nova-compute[71269]:       <mac address="fa:16:3e:4e:57:32"/>
Apr 13 22:58:09 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:58:09 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:58:09 user nova-compute[71269]:       <target dev="tapffc806fb-1b"/>
Apr 13 22:58:09 user nova-compute[71269]:     </interface>
Apr 13 22:58:09 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:58:09 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log" append="off"/>
Apr 13 22:58:09 user nova-compute[71269]:     </serial>
Apr 13 22:58:09 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:58:09 user nova-compute[71269]:     <video>
Apr 13 22:58:09 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:58:09 user nova-compute[71269]:     </video>
Apr 13 22:58:09 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:58:09 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:58:09 user nova-compute[71269]:     </rng>
Apr 13 22:58:09 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:58:09 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:58:09 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:58:09 user nova-compute[71269]:     </memballoon>
Apr 13 22:58:09 user nova-compute[71269]:   </devices>
Apr 13 22:58:09 user nova-compute[71269]: </domain>
Apr 13 22:58:09 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG os_vif [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffc806fb-1b, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffc806fb-1b, col_values=(('external_ids', {'iface-id': 'ffc806fb-1b25-492f-b786-27222f795160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:57:32', 'vm-uuid': '3f6a020c-d8b5-4f6b-a3f0-38287111153a'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:09 user nova-compute[71269]: INFO os_vif [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b')
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name hda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:58:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No VIF found with MAC fa:16:3e:4e:57:32, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:58:09 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Using config drive
Apr 13 22:58:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Creating config drive at /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config
Apr 13 22:58:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplcyl_qk5 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplcyl_qk5" returned: 0 in 0.053s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updated VIF entry in instance network info cache for port ffc806fb-1b25-492f-b786-27222f795160. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:58:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1d2316b7-b194-4cb0-b4b9-f5b94828a7cc req-a5dc3474-8230-4e37-8c9a-5f4dbe0e2fab service nova] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:11 user nova-compute[71269]: WARNING nova.compute.manager [req-867bce98-16e6-4e34-a3c9-d83089c64ad5 req-efdc9d49-8bee-4535-b6a8-4fc879d4e35b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 for instance with vm_state building and task_state spawning.
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426693.5542986, 3f6a020c-d8b5-4f6b-a3f0-38287111153a => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] VM Resumed (Lifecycle Event)
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Instance spawned successfully.
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426693.5586002, 3f6a020c-d8b5-4f6b-a3f0-38287111153a => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] VM Started (Lifecycle Event)
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:13 user nova-compute[71269]: WARNING nova.compute.manager [req-0ad8833b-c221-47b7-8fcc-de5028a877b8 req-9ac21357-0d44-41d9-8588-4f8da7ce3c47 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 for instance with vm_state building and task_state spawning.
Apr 13 22:58:13 user nova-compute[71269]: INFO nova.compute.manager [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Took 6.30 seconds to build instance.
Apr 13 22:58:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d9d6921-e49c-4452-b997-9dd11ed91886 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.386s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:19 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426684.8474686, c10b97ca-3231-41fe-9de5-03cd6dc81e07 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:19 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] VM Stopped (Lifecycle Event)
Apr 13 22:58:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-130992de-0d3d-4310-bbbd-6d798ebc8f0f None None] [instance: c10b97ca-3231-41fe-9de5-03cd6dc81e07] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:24 user nova-compute[71269]: INFO nova.compute.manager [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] instance snapshotting
Apr 13 22:58:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Beginning live snapshot process
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308.delta 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308.delta 1073741824" returned: 0 in 0.277s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 22:58:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] COPY block job progress, current cursor: 196608 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:58:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 22:58:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 22:58:26 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 22:58:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308.delta /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308.delta /opt/stack/data/nova/instances/snapshots/tmpxxnuyn04/6f03703aa3d54bd88f897a97c7f67308" returned: 0 in 0.280s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Snapshot extracted, beginning image upload
Apr 13 22:58:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Snapshot image upload complete
Apr 13 22:58:28 user nova-compute[71269]: INFO nova.compute.manager [None req-e4ef5df1-dfe0-40e4-9a17-528a6e13efde tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Took 4.62 seconds to snapshot the instance on the hypervisor.
Apr 13 22:58:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:30 user nova-compute[71269]: INFO nova.compute.manager [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Unrescuing
Apr 13 22:58:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'flavor' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:31 user nova-compute[71269]: WARNING nova.compute.manager [req-926c05d8-6397-44ed-85f0-de3d74a039ab req-6d399704-5e6e-49d2-aa0e-69cc398054b0 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:58:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance destroyed successfully.
Apr 13 22:58:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing instance network info cache due to event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updated VIF entry in instance network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing instance network info cache due to event network-changed-87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquiring lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquired lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Refreshing network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updated VIF entry in instance network info cache for port 87e984d6-f653-4e7e-a230-53cd27a17d97. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [{"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Releasing lock "refresh_cache-3f241623-e618-42eb-87d1-0606e37ec499" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:34 user nova-compute[71269]: WARNING nova.compute.manager [req-1590b2d9-647c-412f-ae84-67e7522abb3d req-84bf495b-bafd-4e2d-bfcf-14377740d79d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:58:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:35 user nova-compute[71269]: WARNING nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:35 user nova-compute[71269]: WARNING nova.compute.manager [req-b8560b1f-93b3-47d4-812f-2d1f2ccfa003 req-e48625f3-a7b3-4cd4-a983-7215a2ac2589 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 3f241623-e618-42eb-87d1-0606e37ec499 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426715.4188914, 3f241623-e618-42eb-87d1-0606e37ec499 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Resumed (Lifecycle Event)
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ed304229-e52b-447a-95af-9bd29697781c tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:58:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426715.4205015, 3f241623-e618-42eb-87d1-0606e37ec499 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Started (Lifecycle Event)
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:58:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:40 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.compute.manager [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Terminating instance
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-unplugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] No waiting events found dispatching network-vif-unplugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-331ea116-b02e-463c-b136-bcf364b82295 req-8df41a99-ed34-4715-9619-7557470d40ee service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-unplugged-822bdb49-5f9a-4949-8543-929b1764e810 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.compute.manager [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Detaching volume a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.virt.block_device [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Attempting to driver detach volume a58090c7-ce32-4a3f-a2f0-f327259775e7 from mountpoint /dev/vdb
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Attempting to detach device vdb from instance 92e1fa88-8896-4198-af4d-56d44baf3b9b from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:58:41 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:58:41 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 22:58:41 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:58:41 user nova-compute[71269]:   <serial>a58090c7-ce32-4a3f-a2f0-f327259775e7</serial>
Apr 13 22:58:41 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 22:58:41 user nova-compute[71269]: </disk>
Apr 13 22:58:41 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdb from instance 92e1fa88-8896-4198-af4d-56d44baf3b9b from the persistent domain config.
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92e1fa88-8896-4198-af4d-56d44baf3b9b from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:58:41 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:58:41 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 22:58:41 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:58:41 user nova-compute[71269]:   <serial>a58090c7-ce32-4a3f-a2f0-f327259775e7</serial>
Apr 13 22:58:41 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 22:58:41 user nova-compute[71269]: </disk>
Apr 13 22:58:41 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Instance destroyed successfully.
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.objects.instance [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'resources' on Instance uuid 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-839336931',display_name='tempest-AttachVolumeNegativeTest-server-839336931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-839336931',id=6,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGG8geDVsN5KCbwanV43dcTPubxsRVV396AawS43lH/1wpzCdySaKQyIvqwEs0J64zhA20KaUXLOqWWWOfH1mvUaY2xH6JXuK78xj0Ln04BXM/n5aZkAdtXlI21Ph3uoA==',key_name='tempest-keypair-1288429327',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-737ze23t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=0e10dfa7-4997-44b0-b26d-421c7a2d8b63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "822bdb49-5f9a-4949-8543-929b1764e810", "address": "fa:16:3e:91:66:95", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822bdb49-5f", "ovs_interfaceid": "822bdb49-5f9a-4949-8543-929b1764e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG os_vif [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap822bdb49-5f, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:58:41 user nova-compute[71269]: INFO os_vif [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:66:95,bridge_name='br-int',has_traffic_filtering=True,id=822bdb49-5f9a-4949-8543-929b1764e810,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822bdb49-5f')
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Deleting instance files /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63_del
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Deletion of /opt/stack/data/nova/instances/0e10dfa7-4997-44b0-b26d-421c7a2d8b63_del complete
Apr 13 22:58:41 user nova-compute[71269]: INFO nova.compute.manager [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 22:58:41 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:58:41 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426722.1053727, 92e1fa88-8896-4198-af4d-56d44baf3b9b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:58:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdb from instance 92e1fa88-8896-4198-af4d-56d44baf3b9b from the live domain config.
Apr 13 22:58:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKIysTWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:58:42 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d14c10-f1b4-4018-b6fd-a0a35547fe5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:58:42 user nova-compute[71269]: No targets found.
Apr 13 22:58:42 user nova-compute[71269]: iSNS:
Apr 13 22:58:42 user nova-compute[71269]: No targets found.
Apr 13 22:58:42 user nova-compute[71269]: STATIC:
Apr 13 22:58:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 22:58:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:58:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:58:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:58:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:58:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:58:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7
Apr 13 22:58:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:58:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:58:42 user nova-compute[71269]: FIRMWARE:
Apr 13 22:58:42 user nova-compute[71269]: No targets found.
Apr 13 22:58:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:58:42 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:58:42 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3691d3f5-da62-492e-9e48-f4419768c842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac704624-b17e-400f-9f26-39a252a64ba8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc429990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d91ef-71cf-4a26-881d-04e6f50f53ac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e2833-384a-48b2-a959-2535e05a858b]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53b27e-74b0-4d68-8eab-f989bf2906ae]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b7cce9-f34f-4b6f-a62b-cd68aa9dad19]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f41ec-1bcc-4401-b24b-cd15db310a6c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f132816d-3eea-4021-8c21-b544859472df]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260]
Apr 13 22:58:42 user nova-compute[71269]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7, portal: 172.16.0.220,3260] successful.
Apr 13 22:58:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58090c7-ce32-4a3f-a2f0-f327259775e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0eea4-de77-463e-b1de-befddf0b7bff]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== disconnect_volume: return (293ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:43 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Took 1.13 seconds to deallocate network for instance.
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-d8a16bff-e378-4ee7-a9f5-25e4f00d0f0e req-e47e366b-adef-4f51-bdfc-f7c8bc365e8c service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-deleted-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7bbb81cc-d10c-4d8b-a57a-e38b455b3dd2 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:43 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Deleted allocations for instance 0e10dfa7-4997-44b0-b26d-421c7a2d8b63
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Acquiring lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] No waiting events found dispatching network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:43 user nova-compute[71269]: WARNING nova.compute.manager [req-cfec60f9-3471-4e28-b4be-f6cf178504d4 req-44e76c87-a157-4616-bd0d-66c539ff759a service nova] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Received unexpected event network-vif-plugged-822bdb49-5f9a-4949-8543-929b1764e810 for instance with vm_state deleted and task_state None.
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ec829a37-4580-4446-8365-c708f976be8d tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "0e10dfa7-4997-44b0-b26d-421c7a2d8b63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.505s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71269) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance destroyed successfully.
Apr 13 22:58:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c5886cef-5ee7-4f83-b277-1eb0486518b4 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.881s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:45 user nova-compute[71269]: WARNING nova.compute.manager [req-f0ced3de-7aa2-4929-b81e-8eec10d8bd51 req-504af9a8-e238-485e-b870-63a1eb02a348 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state None.
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:47 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:58:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=26.342681884765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.453s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b190941d-9f62-41ef-881d-e02d246e9138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:48 user nova-compute[71269]: INFO nova.compute.manager [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Attaching volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c to /dev/vdb
Apr 13 22:58:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.utils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d2e7e-e8f5-414d-94f0-159cc14039e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61c1c47-368b-4f39-9c95-60eed4b6de54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527b7e9-85ab-481f-9e1e-05eaecc09442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a35a0-bf28-446f-91f9-e5668de64c93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:58:48 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e95d41-1cbb-4a8e-af22-9b44cddc8a72]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG os_brick.utils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating existing volume attachment record: 6fe88dc1-7910-4fbf-be0b-d14100b7b03a {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 22:58:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 22:58:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:58:52 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:58:52 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:58:52 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01774ab-4677-4b1a-8fe0-6987836c994c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:58:52 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[407cafdd-c6cd-49f0-9032-f0eab07de3d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c] added
Apr 13 22:58:52 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a610d9-c226-439e-9c40-3c3de387b5f7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c2fd1e-0d33-433b-b1d2-24452f75ef81]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxklcSDO {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxklcSDO" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf835d03-8d1e-4cd5-9d38-32f6804a18ac]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxklcSDO'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b40732-88fe-465f-82d7-6d4385a97ec7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2921ba-6d46-4e40-9836-d0f45b3dcdfd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9e8f14-8e85-4f85-bae0-b905326fa952]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]
Apr 13 22:58:53 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.
Apr 13 22:58:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4064fbd8-8316-40f1-ad9a-3fa9b35ec3fc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[081095ba-3747-41aa-b6b0-696ed24d8b8e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:58:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:58:53 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:58:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[253e5ea3-5649-4182-95ad-e690da655d2d]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating instance_info_cache with network_info: [{"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-2355fe9d-511a-4e7c-ac2a-5bddc034e063" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:58:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26632626432346462', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632626432346462', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 22:58:54 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:58:54 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 22:58:54 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:58:54 user nova-compute[71269]:   <serial>31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c</serial>
Apr 13 22:58:54 user nova-compute[71269]: </disk>
Apr 13 22:58:54 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No VIF found with MAC fa:16:3e:f9:25:e8, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4fb4cabb-13f4-43e8-bc7d-48f3f37f3c11 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.554s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_power_states {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:56 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426721.8124144, 0e10dfa7-4997-44b0-b26d-421c7a2d8b63 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:56 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] VM Stopped (Lifecycle Event)
Apr 13 22:58:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-417edaa8-6654-41ca-aa36-7a4c09c44783 None None] [instance: 0e10dfa7-4997-44b0-b26d-421c7a2d8b63] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:58:57 user nova-compute[71269]: INFO nova.compute.claims [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Claim successful on node user
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:58:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.policy [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:58:57 user nova-compute[71269]: INFO nova.virt.block_device [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Booting with volume snapshot 826ff984-42c6-41d0-9b1e-47e388886d7b at /dev/vda
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:57 user nova-compute[71269]: INFO nova.compute.manager [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Terminating instance
Apr 13 22:58:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-unplugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] No waiting events found dispatching network-vif-unplugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-1cff86b6-d8ce-4658-b7a7-e9dfbcfb7e26 req-ca512dd4-e70d-44ea-b553-4da780e0efb6 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-unplugged-3958622e-6a70-4931-b630-26e0a53c5755 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Successfully created port: b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:58:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Instance destroyed successfully.
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.objects.instance [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lazy-loading 'resources' on Instance uuid 2355fe9d-511a-4e7c-ac2a-5bddc034e063 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1789468832',display_name='tempest-VolumesAdminNegativeTest-server-1789468832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1789468832',id=7,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObF04qfQe1XUBpXGnJngmDi1GmEIreN0d0ZxA7hkpzFUTJv86Fr4EfbN4NCxkHRaIN2RUxi8ku3mcOnyyqemReBiK8NwWityhFwwbgBqfpTW9dedeBA81mDCVtDqQo2+A==',key_name='tempest-keypair-686921666',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a33cf3bf67714b0ba9c7f703a1c9e5b9',ramdisk_id='',reservation_id='r-kn3txfo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-357530992',owner_user_name='tempest-VolumesAdminNegativeTest-357530992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1b08dea04784bc3b07195f951a84bfb',uuid=2355fe9d-511a-4e7c-ac2a-5bddc034e063,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converting VIF {"id": "3958622e-6a70-4931-b630-26e0a53c5755", "address": "fa:16:3e:bc:7d:a6", "network": {"id": "778950f1-e25a-4ca7-923c-d73459c36663", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-758172716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a33cf3bf67714b0ba9c7f703a1c9e5b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3958622e-6a", "ovs_interfaceid": "3958622e-6a70-4931-b630-26e0a53c5755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG os_vif [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3958622e-6a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:58:58 user nova-compute[71269]: INFO os_vif [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:7d:a6,bridge_name='br-int',has_traffic_filtering=True,id=3958622e-6a70-4931-b630-26e0a53c5755,network=Network(778950f1-e25a-4ca7-923c-d73459c36663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3958622e-6a')
Apr 13 22:58:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Deleting instance files /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063_del
Apr 13 22:58:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Deletion of /opt/stack/data/nova/instances/2355fe9d-511a-4e7c-ac2a-5bddc034e063_del complete
Apr 13 22:58:58 user nova-compute[71269]: INFO nova.compute.manager [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 22:58:58 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:58:58 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:58:59 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426724.5934722, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:58:59 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Stopped (Lifecycle Event)
Apr 13 22:58:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-444da927-1040-4702-b1ab-70ae41d8d928 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:58:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-444da927-1040-4702-b1ab-70ae41d8d928 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Successfully updated port: b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:59:00 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Took 1.72 seconds to deallocate network for instance.
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Acquiring lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] No waiting events found dispatching network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:00 user nova-compute[71269]: WARNING nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received unexpected event network-vif-plugged-3958622e-6a70-4931-b630-26e0a53c5755 for instance with vm_state deleted and task_state None.
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Received event network-vif-deleted-3958622e-6a70-4931-b630-26e0a53c5755 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-changed-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Refreshing instance network info cache due to event network-changed-b06270a1-7c20-4d1a-98b7-4dafc26585e2. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Acquiring lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing instance network info cache due to event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.network.neutron [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:59:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:01 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Deleted allocations for instance 2355fe9d-511a-4e7c-ac2a-5bddc034e063
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Updating instance_info_cache with network_info: [{"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Instance network_info: |[{"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Acquired lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Refreshing network info cache for port b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-74a9e2ff-64b6-403f-909b-b8f294e4fec5 tempest-VolumesAdminNegativeTest-357530992 tempest-VolumesAdminNegativeTest-357530992-project-member] Lock "2355fe9d-511a-4e7c-ac2a-5bddc034e063" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updated VIF entry in instance network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bfd39197-e420-4b53-be47-311218568a9e req-db8864ce-7188-41c6-bca3-c52a5d1e777b service nova] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Updated VIF entry in instance network info cache for port b06270a1-7c20-4d1a-98b7-4dafc26585e2. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Updating instance_info_cache with network_info: [{"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-08961733-443c-4c45-92a7-79b4bf32ee5f req-2c5da241-db44-44e6-b67c-424339379043 service nova] Releasing lock "refresh_cache-bc51e254-7d38-49f6-816e-947d92f95950" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing instance network info cache due to event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.network.neutron [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updated VIF entry in instance network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.network.neutron [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3222cc25-6383-4f54-a4cd-13d23a4d929c req-bf1575c5-bd14-47b2-a8a8-faf7bf22ac68 service nova] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:03 user nova-compute[71269]: INFO nova.compute.manager [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Detaching volume ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:59:03 user nova-compute[71269]: INFO nova.virt.block_device [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Attempting to driver detach volume ad4438c6-dc98-4b87-b570-3881b3bde779 from mountpoint /dev/vdb
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Attempting to detach device vdb from instance 3f241623-e618-42eb-87d1-0606e37ec499 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:59:03 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:59:03 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 22:59:03 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:59:03 user nova-compute[71269]:   <serial>ad4438c6-dc98-4b87-b570-3881b3bde779</serial>
Apr 13 22:59:03 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:59:03 user nova-compute[71269]: </disk>
Apr 13 22:59:03 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:59:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Successfully detached device vdb from instance 3f241623-e618-42eb-87d1-0606e37ec499 from the persistent domain config.
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f241623-e618-42eb-87d1-0606e37ec499 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 22:59:03 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:59:03 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 22:59:03 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 22:59:03 user nova-compute[71269]:   <serial>ad4438c6-dc98-4b87-b570-3881b3bde779</serial>
Apr 13 22:59:03 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 22:59:03 user nova-compute[71269]: </disk>
Apr 13 22:59:03 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93d81b-dbc6-4cf8-91cd-097b0bdecf67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617a536-80e0-47d8-bfc0-fd5e3dd31af6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a6195-a014-4584-8d30-94251c017b82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c487d-6c0d-4929-b594-0a8bb49b4abe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:59:03 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff5838-57ce-4833-b36d-df2da58c7e56]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Updating existing volume attachment record: d8878fb3-1d25-4604-9dd4-f58a1ab48672 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426743.9784186, 3f241623-e618-42eb-87d1-0606e37ec499 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 22:59:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Successfully detached device vdb from instance 3f241623-e618-42eb-87d1-0606e37ec499 from the live domain config.
Apr 13 22:59:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVeGoxqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:03 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd78ded-b15d-43ec-8a07-8eef67017d97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:59:04 user nova-compute[71269]: No targets found.
Apr 13 22:59:04 user nova-compute[71269]: iSNS:
Apr 13 22:59:04 user nova-compute[71269]: No targets found.
Apr 13 22:59:04 user nova-compute[71269]: STATIC:
Apr 13 22:59:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 22:59:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:59:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:59:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779
Apr 13 22:59:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:59:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:59:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 22:59:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:59:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:59:04 user nova-compute[71269]: FIRMWARE:
Apr 13 22:59:04 user nova-compute[71269]: No targets found.
Apr 13 22:59:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:59:04 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:59:04 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825433f-5745-4758-89ba-eb92e5a5636c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e61ae3-9237-4739-99d2-b4d862585927]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:59:04 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:04 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 (non-flash)
Apr 13 22:59:04 user nova-compute[71269]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:04 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[88778de6-aa8b-4da9-8f2e-955bf586d882]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e4f54-c791-4ce1-98f2-54c9accd1282]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa55cb4-9b92-4322-8699-8da735de2d9a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2322d3c4-b45b-4339-86e4-661bebfb2b8c]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974ab98-5837-46f7-ae83-2f77824b246b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[555396e7-6a4c-47e7-b9d2-e87925308980]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260]
Apr 13 22:59:04 user nova-compute[71269]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779, portal: 172.16.0.220,3260] successful.
Apr 13 22:59:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad4438c6-dc98-4b87-b570-3881b3bde779 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6487abe-796c-4fe2-b38d-a66a98ab03a9]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] <== disconnect_volume: return (284ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'flavor' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00ea7bcf-a6a7-4c68-b393-5f2b7fcabf4f tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:05 user nova-compute[71269]: INFO nova.compute.manager [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Rebooting instance
Apr 13 22:59:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:06 user nova-compute[71269]: WARNING nova.compute.manager [req-761f8bb2-3587-4a3e-a8bb-d97ec88834dc req-475598ed-1950-4387-82d9-03f0741c94e6 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 22:59:06 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance destroyed successfully.
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'resources' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:06Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG os_vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37865aaf-d7, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:06 user nova-compute[71269]: INFO os_vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7')
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:07 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[392a8079-6967-433c-9282-d2f0d164be58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 22:59:07 user nova-compute[71269]: No targets found.
Apr 13 22:59:07 user nova-compute[71269]: iSNS:
Apr 13 22:59:07 user nova-compute[71269]: No targets found.
Apr 13 22:59:07 user nova-compute[71269]: STATIC:
Apr 13 22:59:07 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 22:59:07 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:59:07 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:59:07 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 22:59:07 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 22:59:07 user nova-compute[71269]:                 Iface Name: default
Apr 13 22:59:07 user nova-compute[71269]: FIRMWARE:
Apr 13 22:59:07 user nova-compute[71269]: No targets found.
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 22:59:07 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 22:59:07 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d321b67b-1b12-4011-8cb6-b667e507e13d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b262f-e453-43c1-b61b-fbdc587c7808]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc7d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c778ded-6b98-4fdd-bea8-b4c2a641b4bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378d506-e70d-4297-9e12-f9ed0c0eb7f6]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb7352-1b21-4171-8261-11258eb64026]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090a7b2-22a9-4a04-a3c5-36dcd4ffc3e9]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677b2c0-d41e-4508-8cf2-0af10aeb59f6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e21d4-f7b6-41d9-8666-0abdfe19ac0b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]
Apr 13 22:59:07 user nova-compute[71269]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95565026-85f2-458e-b178-a33d98b38ecb]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== disconnect_volume: return (294ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start _get_guest_xml network_info=[{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bd4ff522-0822-422c-8f3d-ad6afaa48909,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'bd4ff522-0822-422c-8f3d-ad6afaa48909'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '6fe88dc1-7910-4fbf-be0b-d14100b7b03a', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b190941d-9f62-41ef-881d-e02d246e9138', 'attached_at': '', 'detached_at': '', 'volume_id': '31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'serial': '31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:59:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bd4ff522-0822-422c-8f3d-ad6afaa48909,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'vcpu_model' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:07 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:07 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:07 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b98d0-0ba3-44b5-b9b0-d4507c9ed16a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:59:07 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c417a1-bd42-4b3a-bf5f-d4bf5c7fbc21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c] added
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde02c6a-6cc0-4d54-bc1c-6813386e1838]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ca5d2-3021-4499-82a0-e20ed6f47fab]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxklcSDO {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxklcSDO" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db086e2-226f-4083-91ee-050432bb81dd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxklcSDO'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dc234-34ff-49b0-9a37-cb0027f8be71]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c9c58-d606-412d-b775-76527d520d5f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb13e1b-4de9-4770-8100-202f6803b397]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]
Apr 13 22:59:07 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f4036-1bc3-4035-a9da-74f9e4ca4dcc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90f28b-5ba4-4420-b646-1d62657d6468]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:07 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ba5cf-89c7-4a8d-9235-040b91140d81]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:59:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:59:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Creating image(s)
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Ensure instance console log exists: /opt/stack/data/nova/instances/bc51e254-7d38-49f6-816e-947d92f95950/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Start _get_guest_xml network_info=[{"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T22:58:54Z,direct_url=<?>,disk_format='qcow2',id=7119a410-f029-4b60-b10c-446ba970d825,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-321252709',owner='d872848d5dc1471996e2f33bbbdebbd9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T22:58:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'd8878fb3-1d25-4604-9dd4-f58a1ab48672', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEBcGNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc51e254-7d38-49f6-816e-947d92f95950', 'attached_at': '', 'detached_at': '', 'volume_id': '84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 'serial': '84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:59:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T22:58:54Z,direct_url=<?>,disk_format='qcow2',id=7119a410-f029-4b60-b10c-446ba970d825,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-321252709',owner='d872848d5dc1471996e2f33bbbdebbd9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T22:58:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEBcGNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:08 user nova-compute[71269]: WARNING nova.compute.manager [req-b3fc2097-45c8-4362-ad7e-3b640f6f9226 req-5671a9db-2130-4f6e-860b-f1554527c3a3 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26632626432346462', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632626432346462', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.274s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:08 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de37ac8-731b-440c-92a5-bfff65c31c9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:59:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:06Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'pci_devices' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:59:08 user nova-compute[71269]:   <uuid>b190941d-9f62-41ef-881d-e02d246e9138</uuid>
Apr 13 22:59:08 user nova-compute[71269]:   <name>instance-0000000e</name>
Apr 13 22:59:08 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:59:08 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:59:08 user nova-compute[71269]:   <metadata>
Apr 13 22:59:08 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:59:08 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:name>tempest-TestMinimumBasicScenario-server-1582878166</nova:name>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:59:07</nova:creationTime>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:59:08 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:59:08 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:owner>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:user uuid="fad76e3a6e154feaa62d95f6e7d1ce1c">tempest-TestMinimumBasicScenario-146514025-project-member</nova:user>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:project uuid="cf532d1c87a34b8cbde0f162688f7cdb">tempest-TestMinimumBasicScenario-146514025</nova:project>
Apr 13 22:59:08 user nova-compute[71269]:       </nova:owner>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:root type="image" uuid="bd4ff522-0822-422c-8f3d-ad6afaa48909"/>
Apr 13 22:59:08 user nova-compute[71269]:       <nova:ports>
Apr 13 22:59:08 user nova-compute[71269]:         <nova:port uuid="37865aaf-d7fb-4f6b-b764-2b75e9d3e924">
Apr 13 22:59:08 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 22:59:08 user nova-compute[71269]:         </nova:port>
Apr 13 22:59:08 user nova-compute[71269]:       </nova:ports>
Apr 13 22:59:08 user nova-compute[71269]:     </nova:instance>
Apr 13 22:59:08 user nova-compute[71269]:   </metadata>
Apr 13 22:59:08 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:59:08 user nova-compute[71269]:     <system>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="serial">b190941d-9f62-41ef-881d-e02d246e9138</entry>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="uuid">b190941d-9f62-41ef-881d-e02d246e9138</entry>
Apr 13 22:59:08 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:59:08 user nova-compute[71269]:     </system>
Apr 13 22:59:08 user nova-compute[71269]:   </sysinfo>
Apr 13 22:59:08 user nova-compute[71269]:   <os>
Apr 13 22:59:08 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:59:08 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:59:08 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:59:08 user nova-compute[71269]:   </os>
Apr 13 22:59:08 user nova-compute[71269]:   <features>
Apr 13 22:59:08 user nova-compute[71269]:     <acpi/>
Apr 13 22:59:08 user nova-compute[71269]:     <apic/>
Apr 13 22:59:08 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:59:08 user nova-compute[71269]:   </features>
Apr 13 22:59:08 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:59:08 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:59:08 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:59:08 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:59:08 user nova-compute[71269]:   </clock>
Apr 13 22:59:08 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:59:08 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:59:08 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:59:08 user nova-compute[71269]:   </cpu>
Apr 13 22:59:08 user nova-compute[71269]:   <devices>
Apr 13 22:59:08 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:59:08 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:59:08 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk"/>
Apr 13 22:59:08 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:59:08 user nova-compute[71269]:     </disk>
Apr 13 22:59:08 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:59:08 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:59:08 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 22:59:08 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 22:59:08 user nova-compute[71269]:       <serial>31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c</serial>
Apr 13 22:59:08 user nova-compute[71269]:     </disk>
Apr 13 22:59:08 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:59:08 user nova-compute[71269]:       <mac address="fa:16:3e:f9:25:e8"/>
Apr 13 22:59:08 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:08 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:59:08 user nova-compute[71269]:       <target dev="tap37865aaf-d7"/>
Apr 13 22:59:08 user nova-compute[71269]:     </interface>
Apr 13 22:59:08 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:59:08 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/console.log" append="off"/>
Apr 13 22:59:08 user nova-compute[71269]:     </serial>
Apr 13 22:59:08 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:59:08 user nova-compute[71269]:     <video>
Apr 13 22:59:08 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:08 user nova-compute[71269]:     </video>
Apr 13 22:59:08 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:59:08 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:59:08 user nova-compute[71269]:     </rng>
Apr 13 22:59:08 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:59:08 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:59:08 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:59:08 user nova-compute[71269]:     </memballoon>
Apr 13 22:59:08 user nova-compute[71269]:   </devices>
Apr 13 22:59:08 user nova-compute[71269]: </domain>
Apr 13 22:59:08 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98de072-047e-4269-ac8c-7ec38761aefc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2] added
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f39c6-1ce5-47ea-8555-36e65aa55203]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955b4ae-a597-47d4-b32b-56f9dc94d04b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEBcGNy {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJEBcGNy" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7931e26-1da2-4ed3-9486-6e9284746159]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJEBcGNy'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[595df533-e9ee-44d8-83a8-d14845b98301]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b15bd7-1eb0-4080-abb2-82be3986ea68]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63cbe1b-3714-4b92-9e2f-902e670324dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260]
Apr 13 22:59:08 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260] successful.
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd7bb5f-5d28-48ca-b5ef-5eebdd3a022d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'trusted_certs' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0810c63-13dd-4437-8e16-419aa1f765e2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.087s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f78bbc-6dde-4f96-a9ed-007fcff53ef2]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEBcGNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Cannot resize image /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'migration_context' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:06Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG os_vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37865aaf-d7, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37865aaf-d7, col_values=(('external_ids', {'iface-id': '37865aaf-d7fb-4f6b-b764-2b75e9d3e924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:25:e8', 'vm-uuid': 'b190941d-9f62-41ef-881d-e02d246e9138'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:09 user nova-compute[71269]: INFO os_vif [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7')
Apr 13 22:59:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1708ms) {'type': 'block', 'scsi_wwn': '26361343238353464', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361343238353464', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-853709521',id=17,image_ref='7119a410-f029-4b60-b10c-446ba970d825',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-8woyu865',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-751187467',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:58:58Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=bc51e254-7d38-49f6-816e-947d92f95950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid bc51e254-7d38-49f6-816e-947d92f95950 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:59:10 user nova-compute[71269]:   <uuid>bc51e254-7d38-49f6-816e-947d92f95950</uuid>
Apr 13 22:59:10 user nova-compute[71269]:   <name>instance-00000011</name>
Apr 13 22:59:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:59:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:59:10 user nova-compute[71269]:   <metadata>
Apr 13 22:59:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:59:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-853709521</nova:name>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:59:08</nova:creationTime>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:59:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:59:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:owner>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 22:59:10 user nova-compute[71269]:       </nova:owner>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:root type="image" uuid="7119a410-f029-4b60-b10c-446ba970d825"/>
Apr 13 22:59:10 user nova-compute[71269]:       <nova:ports>
Apr 13 22:59:10 user nova-compute[71269]:         <nova:port uuid="b06270a1-7c20-4d1a-98b7-4dafc26585e2">
Apr 13 22:59:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 22:59:10 user nova-compute[71269]:         </nova:port>
Apr 13 22:59:10 user nova-compute[71269]:       </nova:ports>
Apr 13 22:59:10 user nova-compute[71269]:     </nova:instance>
Apr 13 22:59:10 user nova-compute[71269]:   </metadata>
Apr 13 22:59:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:59:10 user nova-compute[71269]:     <system>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="serial">bc51e254-7d38-49f6-816e-947d92f95950</entry>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="uuid">bc51e254-7d38-49f6-816e-947d92f95950</entry>
Apr 13 22:59:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:59:10 user nova-compute[71269]:     </system>
Apr 13 22:59:10 user nova-compute[71269]:   </sysinfo>
Apr 13 22:59:10 user nova-compute[71269]:   <os>
Apr 13 22:59:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:59:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:59:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:59:10 user nova-compute[71269]:   </os>
Apr 13 22:59:10 user nova-compute[71269]:   <features>
Apr 13 22:59:10 user nova-compute[71269]:     <acpi/>
Apr 13 22:59:10 user nova-compute[71269]:     <apic/>
Apr 13 22:59:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:59:10 user nova-compute[71269]:   </features>
Apr 13 22:59:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:59:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:59:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:59:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:59:10 user nova-compute[71269]:   </clock>
Apr 13 22:59:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:59:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:59:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:59:10 user nova-compute[71269]:   </cpu>
Apr 13 22:59:10 user nova-compute[71269]:   <devices>
Apr 13 22:59:10 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:59:10 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:59:10 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 22:59:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:59:10 user nova-compute[71269]:       <serial>84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2</serial>
Apr 13 22:59:10 user nova-compute[71269]:     </disk>
Apr 13 22:59:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:59:10 user nova-compute[71269]:       <mac address="fa:16:3e:1b:ee:d2"/>
Apr 13 22:59:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:59:10 user nova-compute[71269]:       <target dev="tapb06270a1-7c"/>
Apr 13 22:59:10 user nova-compute[71269]:     </interface>
Apr 13 22:59:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:59:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/bc51e254-7d38-49f6-816e-947d92f95950/console.log" append="off"/>
Apr 13 22:59:10 user nova-compute[71269]:     </serial>
Apr 13 22:59:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:59:10 user nova-compute[71269]:     <video>
Apr 13 22:59:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:10 user nova-compute[71269]:     </video>
Apr 13 22:59:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:59:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:59:10 user nova-compute[71269]:     </rng>
Apr 13 22:59:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:59:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:59:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:59:10 user nova-compute[71269]:     </memballoon>
Apr 13 22:59:10 user nova-compute[71269]:   </devices>
Apr 13 22:59:10 user nova-compute[71269]: </domain>
Apr 13 22:59:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-853709521',id=17,image_ref='7119a410-f029-4b60-b10c-446ba970d825',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-8woyu865',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-751187467',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:58:58Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=bc51e254-7d38-49f6-816e-947d92f95950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG os_vif [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb06270a1-7c, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb06270a1-7c, col_values=(('external_ids', {'iface-id': 'b06270a1-7c20-4d1a-98b7-4dafc26585e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ee:d2', 'vm-uuid': 'bc51e254-7d38-49f6-816e-947d92f95950'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:10 user nova-compute[71269]: INFO os_vif [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c')
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:59:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:1b:ee:d2, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:11 user nova-compute[71269]: WARNING nova.compute.manager [req-8fe7d4ef-7523-4375-a4a9-d7030b681b75 req-94648024-1011-4194-a3e7-1d1477e095e4 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] No waiting events found dispatching network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:12 user nova-compute[71269]: WARNING nova.compute.manager [req-ecfa4b04-c4f1-4df6-a428-9e1fb9e890b4 req-666204c6-04b5-41a1-bf52-a34a89cb6cf2 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received unexpected event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance with vm_state building and task_state spawning.
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:13 user nova-compute[71269]: WARNING nova.compute.manager [req-0eaca87d-3e3f-4c94-a179-466b8622e30c req-16285329-d5ab-4d33-8d73-97ed60461db1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 22:59:13 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426738.7308426, 2355fe9d-511a-4e7c-ac2a-5bddc034e063 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:13 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] VM Stopped (Lifecycle Event)
Apr 13 22:59:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-291f3f6e-2d81-435a-b3fe-58bd77586359 None None] [instance: 2355fe9d-511a-4e7c-ac2a-5bddc034e063] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] No waiting events found dispatching network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:14 user nova-compute[71269]: WARNING nova.compute.manager [req-76016ef8-728b-4908-80f2-a35c0851f4ea req-4d195f78-d90c-45db-9a50-73b321fcddc9 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received unexpected event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance with vm_state building and task_state spawning.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for b190941d-9f62-41ef-881d-e02d246e9138 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426754.4166844, b190941d-9f62-41ef-881d-e02d246e9138 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] VM Resumed (Lifecycle Event)
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance rebooted successfully.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Instance spawned successfully.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426754.4184437, b190941d-9f62-41ef-881d-e02d246e9138 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] VM Started (Lifecycle Event)
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d8809bb4-b963-4475-87d5-758146f0f174 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.954s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426754.4278615, bc51e254-7d38-49f6-816e-947d92f95950 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] VM Resumed (Lifecycle Event)
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426754.4280443, bc51e254-7d38-49f6-816e-947d92f95950 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] VM Started (Lifecycle Event)
Apr 13 22:59:14 user nova-compute[71269]: INFO nova.compute.manager [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Took 17.55 seconds to build instance.
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-631b1d84-b942-4458-b0c8-e665ec187e9e tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.652s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 22:59:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:59:30 user nova-compute[71269]: INFO nova.compute.claims [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Claim successful on node user
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 22:59:30 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:59:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:59:31 user nova-compute[71269]: INFO nova.virt.block_device [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Booting with blank volume at /dev/vda
Apr 13 22:59:31 user nova-compute[71269]: DEBUG nova.policy [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:59:32 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Successfully created port: 0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Successfully updated port: 0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-changed-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Refreshing instance network info cache due to event network-changed-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance network_info: |[{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Refreshing network info cache for port 0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:33 user nova-compute[71269]: INFO nova.compute.manager [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Unrescuing
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updated VIF entry in instance network info cache for port 0f1a7f33-f5b1-4acf-baac-7e66a5f97d37. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fb76edb0-4e63-49fa-b772-0bfdefe49138 req-81070745-968e-47ae-84e2-3ae54ac36a17 service nova] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:35 user nova-compute[71269]: WARNING nova.compute.manager [req-7cdc5349-db0b-4e9e-8df6-ffe4381743d6 req-c3328f2d-e6c4-4c99-8353-cccb874a53d3 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:59:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 22:59:35 user nova-compute[71269]: INFO nova.compute.claims [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Claim successful on node user
Apr 13 22:59:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance destroyed successfully.
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:59:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.policy [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:59:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Creating image(s)
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "/opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk 1073741824" returned: 0 in 0.050s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Cannot resize image /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'migration_context' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Successfully created port: 79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Ensure instance console log exists: /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.utils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf0a29-8d4e-4332-ae5a-e1db6aa53a46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:37 user nova-compute[71269]: WARNING nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:37 user nova-compute[71269]: WARNING nova.compute.manager [req-832b7cba-7a84-4b98-aa1b-639164e2f5da req-ab09cb65-2945-4d90-9cc7-70a7fd199e33 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state rescued and task_state unrescuing.
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b5403a-5c02-4565-b97c-462a15ee6363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[567bcedc-8840-41cd-be9c-434910ac225e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[107763cf-d36e-4e08-8466-3eee117039a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 22:59:37 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d76c3-e684-4466-9962-44dfd5aa03db]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_brick.utils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating existing volume attachment record: 561562a4-4a3b-4bb8-9bbb-f5f60ba863d6 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Successfully updated port: 79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquired lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-changed-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Refreshing instance network info cache due to event network-changed-79c62453-7ae2-480d-aa21-a5f26dfb0763. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Acquiring lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updating instance_info_cache with network_info: [{"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Releasing lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Instance network_info: |[{"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Acquired lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.neutron [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Refreshing network info cache for port 79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Start _get_guest_xml network_info=[{"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:59:37 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:37 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458287941',display_name='tempest-AttachVolumeNegativeTest-server-1458287941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458287941',id=19,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdIn2aTmD4XbBsFMXMHNsWX5qBMfL70kIjVQgqdNLj3BfmoaBPPsv0YDGx2+i2qNmJlXMHeZYj/opWigP9CFsZryFVOF7OKgBHSIywAoBb74kwwJDqv4tRlH1o7PgrM9Q==',key_name='tempest-keypair-286597101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-y2u05gxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=4435b0c4-7292-4348-bcd9-a712a2df3e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.objects.instance [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'pci_devices' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:59:37 user nova-compute[71269]:   <uuid>4435b0c4-7292-4348-bcd9-a712a2df3e91</uuid>
Apr 13 22:59:37 user nova-compute[71269]:   <name>instance-00000013</name>
Apr 13 22:59:37 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:59:37 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:59:37 user nova-compute[71269]:   <metadata>
Apr 13 22:59:37 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:59:37 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1458287941</nova:name>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:59:37</nova:creationTime>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:59:37 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:59:37 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:owner>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:user uuid="98594f3f6ccf4ffdbfd91bcf192d936e">tempest-AttachVolumeNegativeTest-704876090-project-member</nova:user>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:project uuid="85ccac99656842aca44f9f1eb7aa167a">tempest-AttachVolumeNegativeTest-704876090</nova:project>
Apr 13 22:59:37 user nova-compute[71269]:       </nova:owner>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:59:37 user nova-compute[71269]:       <nova:ports>
Apr 13 22:59:37 user nova-compute[71269]:         <nova:port uuid="79c62453-7ae2-480d-aa21-a5f26dfb0763">
Apr 13 22:59:37 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 22:59:37 user nova-compute[71269]:         </nova:port>
Apr 13 22:59:37 user nova-compute[71269]:       </nova:ports>
Apr 13 22:59:37 user nova-compute[71269]:     </nova:instance>
Apr 13 22:59:37 user nova-compute[71269]:   </metadata>
Apr 13 22:59:37 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:59:37 user nova-compute[71269]:     <system>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="serial">4435b0c4-7292-4348-bcd9-a712a2df3e91</entry>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="uuid">4435b0c4-7292-4348-bcd9-a712a2df3e91</entry>
Apr 13 22:59:37 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:59:37 user nova-compute[71269]:     </system>
Apr 13 22:59:37 user nova-compute[71269]:   </sysinfo>
Apr 13 22:59:37 user nova-compute[71269]:   <os>
Apr 13 22:59:37 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:59:37 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:59:37 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:59:37 user nova-compute[71269]:   </os>
Apr 13 22:59:37 user nova-compute[71269]:   <features>
Apr 13 22:59:37 user nova-compute[71269]:     <acpi/>
Apr 13 22:59:37 user nova-compute[71269]:     <apic/>
Apr 13 22:59:37 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:59:37 user nova-compute[71269]:   </features>
Apr 13 22:59:37 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:59:37 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:59:37 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:59:37 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:59:37 user nova-compute[71269]:   </clock>
Apr 13 22:59:37 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:59:37 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:59:37 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:59:37 user nova-compute[71269]:   </cpu>
Apr 13 22:59:37 user nova-compute[71269]:   <devices>
Apr 13 22:59:37 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 22:59:37 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 22:59:37 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk"/>
Apr 13 22:59:37 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:59:37 user nova-compute[71269]:     </disk>
Apr 13 22:59:37 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:59:37 user nova-compute[71269]:       <mac address="fa:16:3e:4c:71:82"/>
Apr 13 22:59:37 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:37 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:59:37 user nova-compute[71269]:       <target dev="tap79c62453-7a"/>
Apr 13 22:59:37 user nova-compute[71269]:     </interface>
Apr 13 22:59:37 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:59:37 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/console.log" append="off"/>
Apr 13 22:59:37 user nova-compute[71269]:     </serial>
Apr 13 22:59:37 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:59:37 user nova-compute[71269]:     <video>
Apr 13 22:59:37 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:37 user nova-compute[71269]:     </video>
Apr 13 22:59:37 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:59:37 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:59:37 user nova-compute[71269]:     </rng>
Apr 13 22:59:37 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:59:37 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:59:37 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:59:37 user nova-compute[71269]:     </memballoon>
Apr 13 22:59:37 user nova-compute[71269]:   </devices>
Apr 13 22:59:37 user nova-compute[71269]: </domain>
Apr 13 22:59:37 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458287941',display_name='tempest-AttachVolumeNegativeTest-server-1458287941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458287941',id=19,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdIn2aTmD4XbBsFMXMHNsWX5qBMfL70kIjVQgqdNLj3BfmoaBPPsv0YDGx2+i2qNmJlXMHeZYj/opWigP9CFsZryFVOF7OKgBHSIywAoBb74kwwJDqv4tRlH1o7PgrM9Q==',key_name='tempest-keypair-286597101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-y2u05gxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=4435b0c4-7292-4348-bcd9-a712a2df3e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG os_vif [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79c62453-7a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79c62453-7a, col_values=(('external_ids', {'iface-id': '79c62453-7ae2-480d-aa21-a5f26dfb0763', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:71:82', 'vm-uuid': '4435b0c4-7292-4348-bcd9-a712a2df3e91'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:37 user nova-compute[71269]: INFO os_vif [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a')
Apr 13 22:59:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:59:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:4c:71:82, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:59:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updated VIF entry in instance network info cache for port 79c62453-7ae2-480d-aa21-a5f26dfb0763. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updating instance_info_cache with network_info: [{"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0c4387d8-8e19-4f3a-a6c1-fa85260bb07c req-c0adb4ee-ea4d-49a4-ab7e-f788b6e45c7f service nova] Releasing lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 22:59:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for df12dd8d-ea02-4c59-804d-52ae1bd4a555 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426779.1488504, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Resumed (Lifecycle Event)
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f912ab4-213c-426b-85ea-72deffb1250e tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426779.1539118, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Started (Lifecycle Event)
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:39 user nova-compute[71269]: WARNING nova.compute.manager [req-8128e5d4-1164-4e83-8cda-c40ff6575fa3 req-f0a518f2-8552-4df7-9e0c-0dd623762a17 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state active and task_state None.
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:39 user nova-compute[71269]: WARNING nova.compute.manager [req-41d81468-c8c1-4a2a-89cf-c2c73784017b req-eb2a5ed5-4b4c-4495-85d7-80aa81e711b3 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state building and task_state spawning.
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:41 user nova-compute[71269]: WARNING nova.compute.manager [req-5bda1ce8-6fda-476a-a7c9-d215472b1eee req-b218a870-9da1-4c5c-be46-659d3db3cbe0 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state building and task_state spawning.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426781.6850047, 4435b0c4-7292-4348-bcd9-a712a2df3e91 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] VM Resumed (Lifecycle Event)
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Instance spawned successfully.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426781.6872754, 4435b0c4-7292-4348-bcd9-a712a2df3e91 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] VM Started (Lifecycle Event)
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Took 5.92 seconds to spawn the instance on the hypervisor.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.compute.manager [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Took 6.67 seconds to build instance.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 22:59:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Creating image(s)
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Ensure instance console log exists: /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start _get_guest_xml network_info=[{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '561562a4-4a3b-4bb8-9bbb-f5f60ba863d6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31ec73b0-9b2a-4fc1-be85-4179075afdb8', 'attached_at': '', 'detached_at': '', 'volume_id': '8872b098-b9f8-4636-a183-7cc7ee479ac2', 'serial': '8872b098-b9f8-4636-a183-7cc7ee479ac2'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-458a6c8c-5f3d-4032-99a5-021f25cf9d99 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.768s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:41 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:41 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 22:59:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 22:59:41 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:41 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:42 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 22:59:42 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8277dd6e-0e48-445e-842a-72d2a366405e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 22:59:42 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7982cd-4fbd-46f4-9ee6-2cd26818a60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2] added
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1453e24-fdd4-45d2-ada6-0e0793bf2963]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bcd77a-9e8c-46a4-9f9f-adbfb6a680f6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPCUlxyb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPCUlxyb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6add9c-f1b0-4536-a067-4a345605ab22]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPCUlxyb'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9773cf47-7470-4d4f-ab6a-f369cb483202]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2c141c-3606-454c-a01a-953dc02e1a36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80d50a4-eaac-44b5-b7ce-dc9d9f039d0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260]
Apr 13 22:59:42 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260] successful.
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959ca4a-65fd-411c-ae2f-7cbcbae3e8c0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1942c-3926-4d52-86a7-b91d9ea1e47e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 22:59:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[081fc1c1-6614-43be-af0e-2f3f157efa83]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 22:59:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26661646632313139', 'path': '/dev/sdd'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661646632313139', 'path': '/dev/sdd'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343743038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343743038',id=18,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-7qxuk3m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:31Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=31ec73b0-9b2a-4fc1-be85-4179075afdb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 22:59:43 user nova-compute[71269]:   <uuid>31ec73b0-9b2a-4fc1-be85-4179075afdb8</uuid>
Apr 13 22:59:43 user nova-compute[71269]:   <name>instance-00000012</name>
Apr 13 22:59:43 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 22:59:43 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 22:59:43 user nova-compute[71269]:   <metadata>
Apr 13 22:59:43 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 22:59:43 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1343743038</nova:name>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:creationTime>2023-04-13 22:59:41</nova:creationTime>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 22:59:43 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 22:59:43 user nova-compute[71269]:       </nova:flavor>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:owner>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 22:59:43 user nova-compute[71269]:       </nova:owner>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 22:59:43 user nova-compute[71269]:       <nova:ports>
Apr 13 22:59:43 user nova-compute[71269]:         <nova:port uuid="0f1a7f33-f5b1-4acf-baac-7e66a5f97d37">
Apr 13 22:59:43 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 22:59:43 user nova-compute[71269]:         </nova:port>
Apr 13 22:59:43 user nova-compute[71269]:       </nova:ports>
Apr 13 22:59:43 user nova-compute[71269]:     </nova:instance>
Apr 13 22:59:43 user nova-compute[71269]:   </metadata>
Apr 13 22:59:43 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 22:59:43 user nova-compute[71269]:     <system>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="serial">31ec73b0-9b2a-4fc1-be85-4179075afdb8</entry>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="uuid">31ec73b0-9b2a-4fc1-be85-4179075afdb8</entry>
Apr 13 22:59:43 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 22:59:43 user nova-compute[71269]:     </system>
Apr 13 22:59:43 user nova-compute[71269]:   </sysinfo>
Apr 13 22:59:43 user nova-compute[71269]:   <os>
Apr 13 22:59:43 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 22:59:43 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 22:59:43 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 22:59:43 user nova-compute[71269]:   </os>
Apr 13 22:59:43 user nova-compute[71269]:   <features>
Apr 13 22:59:43 user nova-compute[71269]:     <acpi/>
Apr 13 22:59:43 user nova-compute[71269]:     <apic/>
Apr 13 22:59:43 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 22:59:43 user nova-compute[71269]:   </features>
Apr 13 22:59:43 user nova-compute[71269]:   <clock offset="utc">
Apr 13 22:59:43 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 22:59:43 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 22:59:43 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 22:59:43 user nova-compute[71269]:   </clock>
Apr 13 22:59:43 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 22:59:43 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 22:59:43 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 22:59:43 user nova-compute[71269]:   </cpu>
Apr 13 22:59:43 user nova-compute[71269]:   <devices>
Apr 13 22:59:43 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 22:59:43 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 22:59:43 user nova-compute[71269]:       <source dev="/dev/sdd"/>
Apr 13 22:59:43 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 22:59:43 user nova-compute[71269]:       <serial>8872b098-b9f8-4636-a183-7cc7ee479ac2</serial>
Apr 13 22:59:43 user nova-compute[71269]:     </disk>
Apr 13 22:59:43 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 22:59:43 user nova-compute[71269]:       <mac address="fa:16:3e:34:11:5b"/>
Apr 13 22:59:43 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:43 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 22:59:43 user nova-compute[71269]:       <target dev="tap0f1a7f33-f5"/>
Apr 13 22:59:43 user nova-compute[71269]:     </interface>
Apr 13 22:59:43 user nova-compute[71269]:     <serial type="pty">
Apr 13 22:59:43 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/console.log" append="off"/>
Apr 13 22:59:43 user nova-compute[71269]:     </serial>
Apr 13 22:59:43 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 22:59:43 user nova-compute[71269]:     <video>
Apr 13 22:59:43 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 22:59:43 user nova-compute[71269]:     </video>
Apr 13 22:59:43 user nova-compute[71269]:     <rng model="virtio">
Apr 13 22:59:43 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 22:59:43 user nova-compute[71269]:     </rng>
Apr 13 22:59:43 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 22:59:43 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 22:59:43 user nova-compute[71269]:       <stats period="10"/>
Apr 13 22:59:43 user nova-compute[71269]:     </memballoon>
Apr 13 22:59:43 user nova-compute[71269]:   </devices>
Apr 13 22:59:43 user nova-compute[71269]: </domain>
Apr 13 22:59:43 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343743038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343743038',id=18,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-7qxuk3m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:31Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=31ec73b0-9b2a-4fc1-be85-4179075afdb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG os_vif [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f1a7f33-f5, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f1a7f33-f5, col_values=(('external_ids', {'iface-id': '0f1a7f33-f5b1-4acf-baac-7e66a5f97d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:11:5b', 'vm-uuid': '31ec73b0-9b2a-4fc1-be85-4179075afdb8'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: INFO os_vif [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5')
Apr 13 22:59:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 22:59:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:34:11:5b, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 22:59:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:45 user nova-compute[71269]: WARNING nova.compute.manager [req-02fadf04-d340-4376-aa02-7e5b24dcfa1a req-93dadbba-5fce-4d53-a803-16cb6756f002 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state building and task_state spawning.
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:45 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426787.1723819, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Resumed (Lifecycle Event)
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance spawned successfully.
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426787.1826465, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Started (Lifecycle Event)
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:47 user nova-compute[71269]: WARNING nova.compute.manager [req-ac2d786e-097c-49e3-9298-b7d2d2a54077 req-45e62afd-2d21-40f3-8b57-1cae63b60bf2 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state building and task_state spawning.
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 13 22:59:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 22:59:47 user nova-compute[71269]: INFO nova.compute.manager [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Took 16.78 seconds to build instance.
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6cb19c27-7e05-4e74-a805-9fe860e71010 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.879s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 22:59:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 22:59:49 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:49 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=26.366432189941406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f241623-e618-42eb-87d1-0606e37ec499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b190941d-9f62-41ef-881d-e02d246e9138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance bc51e254-7d38-49f6-816e-947d92f95950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 22:59:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 22:59:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 22:59:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:57 user nova-compute[71269]: INFO nova.compute.manager [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Terminating instance
Apr 13 22:59:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 22:59:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-5cd84573-db6d-41dc-90c0-0a51cd99ff26 req-63a4034c-f7a5-4e10-a223-ac0f73406b30 service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-unplugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 22:59:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Instance destroyed successfully.
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lazy-loading 'resources' on Instance uuid 3f241623-e618-42eb-87d1-0606e37ec499 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1424032268',display_name='tempest-ServerStableDeviceRescueTest-server-1424032268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1424032268',id=1,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReEIIBUGN/js2VOAZ0TEIC4I0cZ3TqzAV1r7zPJAF/zIEIbTTJ6VirMRIqofzAmD3hSWWBbJmL3KAKtQPR9xf0O/2/ghxrWTFBBAxj0zncVIMD3cx/w1GJEFykqUBh0Q==',key_name='tempest-keypair-1726987531',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:56:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d502d982f4fe424a8df8149962d46963',ramdisk_id='',reservation_id='r-ca12h6n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-149870328',owner_user_name='tempest-ServerStableDeviceRescueTest-149870328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f03ab225421441098f94350bef24442',uuid=3f241623-e618-42eb-87d1-0606e37ec499,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converting VIF {"id": "87e984d6-f653-4e7e-a230-53cd27a17d97", "address": "fa:16:3e:66:5b:e9", "network": {"id": "3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-469794988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d502d982f4fe424a8df8149962d46963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87e984d6-f6", "ovs_interfaceid": "87e984d6-f653-4e7e-a230-53cd27a17d97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG os_vif [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87e984d6-f6, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:58 user nova-compute[71269]: INFO os_vif [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5b:e9,bridge_name='br-int',has_traffic_filtering=True,id=87e984d6-f653-4e7e-a230-53cd27a17d97,network=Network(3a2b9cec-5359-4ed9-8adf-18e3ca8aeb07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87e984d6-f6')
Apr 13 22:59:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Deleting instance files /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499_del
Apr 13 22:59:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Deletion of /opt/stack/data/nova/instances/3f241623-e618-42eb-87d1-0606e37ec499_del complete
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-changed-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing instance network info cache due to event network-changed-ffc806fb-1b25-492f-b786-27222f795160. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing network info cache for port ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 22:59:58 user nova-compute[71269]: INFO nova.compute.manager [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 22:59:58 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 22:59:58 user nova-compute[71269]: DEBUG nova.objects.instance [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'pci_requests' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG nova.network.neutron [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG nova.policy [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ec0b2d09be54070ab00037165788f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8b1ce9b9f4d4adf8316110aae9e04d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updated VIF entry in instance network info cache for port ffc806fb-1b25-492f-b786-27222f795160. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 22:59:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3d55ac8a-0ca3-4a37-a994-9607cf327c99 req-13dea4ee-e3cc-4bbd-b0fb-ae52a23e4651 service nova] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Acquiring lock "3f241623-e618-42eb-87d1-0606e37ec499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] Lock "3f241623-e618-42eb-87d1-0606e37ec499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] No waiting events found dispatching network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:00 user nova-compute[71269]: WARNING nova.compute.manager [req-9bf7f997-5f49-4526-b1da-e34872c28d3a req-9d4d0a52-40a8-4c24-895b-c1cb4f30ad6d service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received unexpected event network-vif-plugged-87e984d6-f653-4e7e-a230-53cd27a17d97 for instance with vm_state active and task_state deleting.
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:00 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Took 2.02 seconds to deallocate network for instance.
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ef9d92d-2eca-45a7-92c2-233cb9dee0c3 req-77f80e1b-3643-4ed9-bfea-a12ff254699e service nova] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Received event network-vif-deleted-87e984d6-f653-4e7e-a230-53cd27a17d97 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Successfully created port: 80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:00 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Deleted allocations for instance 3f241623-e618-42eb-87d1-0606e37ec499
Apr 13 23:00:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b99668d8-8325-49e5-8f2d-b23d8e74a824 tempest-ServerStableDeviceRescueTest-149870328 tempest-ServerStableDeviceRescueTest-149870328-project-member] Lock "3f241623-e618-42eb-87d1-0606e37ec499" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.486s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Successfully updated port: 80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.neutron [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG os_vif [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80cfe92e-46, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80cfe92e-46, col_values=(('external_ids', {'iface-id': '80cfe92e-4656-4479-bb8c-4d66815c678d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d6:4a', 'vm-uuid': '3f6a020c-d8b5-4f6b-a3f0-38287111153a'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-changed-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing instance network info cache due to event network-changed-80cfe92e-4656-4479-bb8c-4d66815c678d. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Refreshing network info cache for port 80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: INFO os_vif [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46')
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] attach device xml: <interface type="ethernet">
Apr 13 23:00:02 user nova-compute[71269]:   <mac address="fa:16:3e:22:d6:4a"/>
Apr 13 23:00:02 user nova-compute[71269]:   <model type="virtio"/>
Apr 13 23:00:02 user nova-compute[71269]:   <mtu size="1442"/>
Apr 13 23:00:02 user nova-compute[71269]:   <target dev="tap80cfe92e-46"/>
Apr 13 23:00:02 user nova-compute[71269]: </interface>
Apr 13 23:00:02 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name hda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No VIF found with MAC fa:16:3e:4e:57:32, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:02 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:02</nova:creationTime>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:02 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:02 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:02 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:02 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:02 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:02 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:02 user nova-compute[71269]:     <nova:port uuid="80cfe92e-4656-4479-bb8c-4d66815c678d">
Apr 13 23:00:02 user nova-compute[71269]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 13 23:00:02 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:02 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:02 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:02 user nova-compute[71269]:  {{(pid=71269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updated VIF entry in instance network info cache for port 80cfe92e-4656-4479-bb8c-4d66815c678d. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:02 user nova-compute[71269]: WARNING nova.compute.manager [req-0d2e3ec8-f50f-4723-b236-7a256a430aa5 req-a905852e-1507-4a5a-b25a-1fc2ade5da2e service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d for instance with vm_state active and task_state None.
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-55a49551-5be0-4089-a3b1-e73bbd2b9eb1 req-37828020-ebc9-4ee8-aa3c-9c57da272d56 service nova] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-93652116-da59-4cea-87bf-819d7df305e1 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.297s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:03 user nova-compute[71269]: INFO nova.compute.manager [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Attaching volume e13bf1b1-a704-41d2-980c-6ed200951f6a to /dev/vdb
Apr 13 23:00:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d5003-0faa-4501-b6f7-5053d04bda21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f85eb-2225-4d3d-9d78-8216ac5b2200]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01036e0-90a0-4674-ae58-e7889b9daef9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44473561-a1e3-4a85-addb-b8ebc3861ce2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:03 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:00:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ee34c-9de6-428d-835a-fba4c37fb892]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG os_brick.utils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:03 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating existing volume attachment record: 05b2fa45-3350-47d2-a8f9-2ced927fc1d6 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:00:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:05 user nova-compute[71269]: WARNING nova.compute.manager [req-14cda272-9c53-4d7b-8aa6-26c7c1f83471 req-f508d4dc-c175-4080-9903-f537de0d22c3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d for instance with vm_state active and task_state None.
Apr 13 23:00:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZSGTQtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:08 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[08779b90-0224-42e5-99e3-3a5489b0af0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:00:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff5f2e-bdd1-41e6-a03a-76e1767bc22f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a] added
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718b7ee-1f9f-4a3b-9ad9-cb4f9a79c8e0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde91d91-f50a-438b-bc06-27589b448a67]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rZSGTQtc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rZSGTQtc" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[288e7ddf-35d4-495c-b4da-7c83d96ffc40]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rZSGTQtc'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbe5a6-a26b-4f96-82df-445ffeb7b112]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc83ebc-9c74-4ad7-a758-c648bf270333]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a968ad2-dffe-4341-aa16-db2c66306306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260]
Apr 13 23:00:08 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba279d5-589c-47e2-b1f8-37b3db22f60e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[174efe80-924b-4b2a-b8f3-bceb81b6c74e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:08 user nova-compute[71269]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)
Apr 13 23:00:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408e43d-6b82-490a-8539-ca24e37dfb7a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZSGTQtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:00:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23237396533656434', 'path': '/dev/sdf'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237396533656434', 'path': '/dev/sdf'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:00:09 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:09 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 23:00:09 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:00:09 user nova-compute[71269]:   <serial>e13bf1b1-a704-41d2-980c-6ed200951f6a</serial>
Apr 13 23:00:09 user nova-compute[71269]: </disk>
Apr 13 23:00:09 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No BDM found with device name hda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] No VIF found with MAC fa:16:3e:4e:57:32, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:00:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2d044094-358f-445c-b244-32176845a150 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.605s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:11 user nova-compute[71269]: INFO nova.compute.manager [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Detaching volume e13bf1b1-a704-41d2-980c-6ed200951f6a
Apr 13 23:00:11 user nova-compute[71269]: INFO nova.virt.block_device [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Attempting to driver detach volume e13bf1b1-a704-41d2-980c-6ed200951f6a from mountpoint /dev/vdb
Apr 13 23:00:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Attempting to detach device vdb from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:00:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:00:11 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:11 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 23:00:11 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:00:11 user nova-compute[71269]:   <serial>e13bf1b1-a704-41d2-980c-6ed200951f6a</serial>
Apr 13 23:00:11 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 23:00:11 user nova-compute[71269]: </disk>
Apr 13 23:00:11 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully detached device vdb from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the persistent domain config.
Apr 13 23:00:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:00:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:00:11 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:11 user nova-compute[71269]:   <source dev="/dev/sdf"/>
Apr 13 23:00:11 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:00:11 user nova-compute[71269]:   <serial>e13bf1b1-a704-41d2-980c-6ed200951f6a</serial>
Apr 13 23:00:11 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 23:00:11 user nova-compute[71269]: </disk>
Apr 13 23:00:11 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426812.3263733, 3f6a020c-d8b5-4f6b-a3f0-38287111153a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:00:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully detached device vdb from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the live domain config.
Apr 13 23:00:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rZSGTQtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a608113-2ef9-4eef-9c65-75f6a70339a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:00:12 user nova-compute[71269]: No targets found.
Apr 13 23:00:12 user nova-compute[71269]: iSNS:
Apr 13 23:00:12 user nova-compute[71269]: No targets found.
Apr 13 23:00:12 user nova-compute[71269]: STATIC:
Apr 13 23:00:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2
Apr 13 23:00:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a
Apr 13 23:00:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 23:00:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:00:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 23:00:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:12 user nova-compute[71269]: FIRMWARE:
Apr 13 23:00:12 user nova-compute[71269]: No targets found.
Apr 13 23:00:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:00:12 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:00:12 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074e91b-1b82-44a1-9c29-17f20c19b8a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef06b985-aeb3-476d-993e-e9c12801a8ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)
Apr 13 23:00:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:12 user nova-compute[71269]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a (non-flash)
Apr 13 23:00:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1880d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a'): ({'sdf'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Removing single pathed devices sdf {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b1856-62f7-4bea-869d-00cc910c9ec2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[360be93e-efd9-4c2c-8b14-f13745fae8dd]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Flushing IO for device /dev/sdf {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91728e-c044-4ea4-9780-2c062a607b25]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[02907993-6dd2-48cc-a82f-98a7294de6ca]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ea737-c327-4dea-9981-b8baea1a961d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[73603dc9-5333-4675-9dd3-b70ea7ccc5c0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260]
Apr 13 23:00:12 user nova-compute[71269]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13bf1b1-a704-41d2-980c-6ed200951f6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c0c27-4239-4bd6-b7b4-6cbf0e56aa20]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] <== disconnect_volume: return (341ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426798.1592047, 3f241623-e618-42eb-87d1-0606e37ec499 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:00:13 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] VM Stopped (Lifecycle Event)
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-70ddd9dd-c0cb-4246-a92f-641ca4ff8c01 None None] [instance: 3f241623-e618-42eb-87d1-0606e37ec499] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8ca154e3-927e-48d1-a21c-d85fba535999 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.034s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-80cfe92e-4656-4479-bb8c-4d66815c678d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-80cfe92e-4656-4479-bb8c-4d66815c678d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Attempting to detach device tap80cfe92e-46 from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] detach device xml: <interface type="ethernet">
Apr 13 23:00:13 user nova-compute[71269]:   <mac address="fa:16:3e:22:d6:4a"/>
Apr 13 23:00:13 user nova-compute[71269]:   <model type="virtio"/>
Apr 13 23:00:13 user nova-compute[71269]:   <mtu size="1442"/>
Apr 13 23:00:13 user nova-compute[71269]:   <target dev="tap80cfe92e-46"/>
Apr 13 23:00:13 user nova-compute[71269]: </interface>
Apr 13 23:00:13 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface>not found in domain: <domain type='kvm' id='20'>
Apr 13 23:00:13 user nova-compute[71269]:   <name>instance-00000010</name>
Apr 13 23:00:13 user nova-compute[71269]:   <uuid>3f6a020c-d8b5-4f6b-a3f0-38287111153a</uuid>
Apr 13 23:00:13 user nova-compute[71269]:   <metadata>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:13 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:02</nova:creationTime>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:13 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:13 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:13 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:13 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:13 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:13 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:13 user nova-compute[71269]:     <nova:port uuid="80cfe92e-4656-4479-bb8c-4d66815c678d">
Apr 13 23:00:13 user nova-compute[71269]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 13 23:00:13 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:13 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:13 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:13 user nova-compute[71269]:   </metadata>
Apr 13 23:00:13 user nova-compute[71269]:   <memory unit='KiB'>131072</memory>
Apr 13 23:00:13 user nova-compute[71269]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 23:00:13 user nova-compute[71269]:   <vcpu placement='static'>1</vcpu>
Apr 13 23:00:13 user nova-compute[71269]:   <resource>
Apr 13 23:00:13 user nova-compute[71269]:     <partition>/machine</partition>
Apr 13 23:00:13 user nova-compute[71269]:   </resource>
Apr 13 23:00:13 user nova-compute[71269]:   <sysinfo type='smbios'>
Apr 13 23:00:13 user nova-compute[71269]:     <system>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='version'>0.0.0</entry>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='serial'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='uuid'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:13 user nova-compute[71269]:       <entry name='family'>Virtual Machine</entry>
Apr 13 23:00:13 user nova-compute[71269]:     </system>
Apr 13 23:00:13 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:13 user nova-compute[71269]:   <os>
Apr 13 23:00:13 user nova-compute[71269]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 23:00:13 user nova-compute[71269]:     <boot dev='hd'/>
Apr 13 23:00:13 user nova-compute[71269]:     <smbios mode='sysinfo'/>
Apr 13 23:00:13 user nova-compute[71269]:   </os>
Apr 13 23:00:13 user nova-compute[71269]:   <features>
Apr 13 23:00:13 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:13 user nova-compute[71269]:     <apic/>
Apr 13 23:00:13 user nova-compute[71269]:     <vmcoreinfo state='on'/>
Apr 13 23:00:13 user nova-compute[71269]:   </features>
Apr 13 23:00:13 user nova-compute[71269]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 23:00:13 user nova-compute[71269]:     <model fallback='forbid'>Nehalem</model>
Apr 13 23:00:13 user nova-compute[71269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 23:00:13 user nova-compute[71269]:     <feature policy='require' name='vme'/>
Apr 13 23:00:13 user nova-compute[71269]:     <feature policy='require' name='x2apic'/>
Apr 13 23:00:13 user nova-compute[71269]:     <feature policy='require' name='hypervisor'/>
Apr 13 23:00:13 user nova-compute[71269]:   </cpu>
Apr 13 23:00:13 user nova-compute[71269]:   <clock offset='utc'>
Apr 13 23:00:13 user nova-compute[71269]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 23:00:13 user nova-compute[71269]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 23:00:13 user nova-compute[71269]:     <timer name='hpet' present='no'/>
Apr 13 23:00:13 user nova-compute[71269]:   </clock>
Apr 13 23:00:13 user nova-compute[71269]:   <on_poweroff>destroy</on_poweroff>
Apr 13 23:00:13 user nova-compute[71269]:   <on_reboot>restart</on_reboot>
Apr 13 23:00:13 user nova-compute[71269]:   <on_crash>destroy</on_crash>
Apr 13 23:00:13 user nova-compute[71269]:   <devices>
Apr 13 23:00:13 user nova-compute[71269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 23:00:13 user nova-compute[71269]:     <disk type='file' device='disk'>
Apr 13 23:00:13 user nova-compute[71269]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 23:00:13 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk' index='2'/>
Apr 13 23:00:13 user nova-compute[71269]:       <backingStore type='file' index='3'>
Apr 13 23:00:13 user nova-compute[71269]:         <format type='raw'/>
Apr 13 23:00:13 user nova-compute[71269]:         <source file='/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f'/>
Apr 13 23:00:13 user nova-compute[71269]:         <backingStore/>
Apr 13 23:00:13 user nova-compute[71269]:       </backingStore>
Apr 13 23:00:13 user nova-compute[71269]:       <target dev='vda' bus='virtio'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='virtio-disk0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </disk>
Apr 13 23:00:13 user nova-compute[71269]:     <disk type='file' device='cdrom'>
Apr 13 23:00:13 user nova-compute[71269]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 23:00:13 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config' index='1'/>
Apr 13 23:00:13 user nova-compute[71269]:       <backingStore/>
Apr 13 23:00:13 user nova-compute[71269]:       <target dev='hda' bus='ide'/>
Apr 13 23:00:13 user nova-compute[71269]:       <readonly/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='ide0-0-0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </disk>
Apr 13 23:00:13 user nova-compute[71269]:     <controller type='usb' index='0' model='none'>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='usb'/>
Apr 13 23:00:13 user nova-compute[71269]:     </controller>
Apr 13 23:00:13 user nova-compute[71269]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='pci.0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </controller>
Apr 13 23:00:13 user nova-compute[71269]:     <controller type='ide' index='0'>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='ide'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 23:00:13 user nova-compute[71269]:     </controller>
Apr 13 23:00:13 user nova-compute[71269]:     <interface type='ethernet'>
Apr 13 23:00:13 user nova-compute[71269]:       <mac address='fa:16:3e:4e:57:32'/>
Apr 13 23:00:13 user nova-compute[71269]:       <target dev='tapffc806fb-1b'/>
Apr 13 23:00:13 user nova-compute[71269]:       <model type='virtio'/>
Apr 13 23:00:13 user nova-compute[71269]:       <mtu size='1442'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='net0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </interface>
Apr 13 23:00:13 user nova-compute[71269]:     <interface type='ethernet'>
Apr 13 23:00:13 user nova-compute[71269]:       <mac address='fa:16:3e:22:d6:4a'/>
Apr 13 23:00:13 user nova-compute[71269]:       <target dev='tap80cfe92e-46'/>
Apr 13 23:00:13 user nova-compute[71269]:       <model type='virtio'/>
Apr 13 23:00:13 user nova-compute[71269]:       <mtu size='1442'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='net1'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </interface>
Apr 13 23:00:13 user nova-compute[71269]:     <serial type='pty'>
Apr 13 23:00:13 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:13 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:13 user nova-compute[71269]:       <target type='isa-serial' port='0'>
Apr 13 23:00:13 user nova-compute[71269]:         <model name='isa-serial'/>
Apr 13 23:00:13 user nova-compute[71269]:       </target>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </serial>
Apr 13 23:00:13 user nova-compute[71269]:     <console type='pty' tty='/dev/pts/3'>
Apr 13 23:00:13 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:13 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:13 user nova-compute[71269]:       <target type='serial' port='0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </console>
Apr 13 23:00:13 user nova-compute[71269]:     <input type='mouse' bus='ps2'>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='input0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </input>
Apr 13 23:00:13 user nova-compute[71269]:     <input type='keyboard' bus='ps2'>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='input1'/>
Apr 13 23:00:13 user nova-compute[71269]:     </input>
Apr 13 23:00:13 user nova-compute[71269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 23:00:13 user nova-compute[71269]:       <listen type='address' address='0.0.0.0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </graphics>
Apr 13 23:00:13 user nova-compute[71269]:     <audio id='1' type='none'/>
Apr 13 23:00:13 user nova-compute[71269]:     <video>
Apr 13 23:00:13 user nova-compute[71269]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='video0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </video>
Apr 13 23:00:13 user nova-compute[71269]:     <memballoon model='virtio'>
Apr 13 23:00:13 user nova-compute[71269]:       <stats period='10'/>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='balloon0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:13 user nova-compute[71269]:     <rng model='virtio'>
Apr 13 23:00:13 user nova-compute[71269]:       <backend model='random'>/dev/urandom</backend>
Apr 13 23:00:13 user nova-compute[71269]:       <alias name='rng0'/>
Apr 13 23:00:13 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 23:00:13 user nova-compute[71269]:     </rng>
Apr 13 23:00:13 user nova-compute[71269]:   </devices>
Apr 13 23:00:13 user nova-compute[71269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 23:00:13 user nova-compute[71269]:     <label>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</label>
Apr 13 23:00:13 user nova-compute[71269]:     <imagelabel>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</imagelabel>
Apr 13 23:00:13 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:13 user nova-compute[71269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 23:00:13 user nova-compute[71269]:     <label>+64055:+108</label>
Apr 13 23:00:13 user nova-compute[71269]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 23:00:13 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:13 user nova-compute[71269]: </domain>
Apr 13 23:00:13 user nova-compute[71269]:  {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 23:00:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully detached device tap80cfe92e-46 from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the persistent domain config.
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] (1/8): Attempting to detach device tap80cfe92e-46 with device alias net1 from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:00:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] detach device xml: <interface type="ethernet">
Apr 13 23:00:13 user nova-compute[71269]:   <mac address="fa:16:3e:22:d6:4a"/>
Apr 13 23:00:13 user nova-compute[71269]:   <model type="virtio"/>
Apr 13 23:00:13 user nova-compute[71269]:   <mtu size="1442"/>
Apr 13 23:00:13 user nova-compute[71269]:   <target dev="tap80cfe92e-46"/>
Apr 13 23:00:13 user nova-compute[71269]: </interface>
Apr 13 23:00:13 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426814.1884763, 3f6a020c-d8b5-4f6b-a3f0-38287111153a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Start waiting for the detach event from libvirt for device tap80cfe92e-46 with device alias net1 for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface>not found in domain: <domain type='kvm' id='20'>
Apr 13 23:00:14 user nova-compute[71269]:   <name>instance-00000010</name>
Apr 13 23:00:14 user nova-compute[71269]:   <uuid>3f6a020c-d8b5-4f6b-a3f0-38287111153a</uuid>
Apr 13 23:00:14 user nova-compute[71269]:   <metadata>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:14 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:02</nova:creationTime>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:14 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="80cfe92e-4656-4479-bb8c-4d66815c678d">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:14 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:14 user nova-compute[71269]:   </metadata>
Apr 13 23:00:14 user nova-compute[71269]:   <memory unit='KiB'>131072</memory>
Apr 13 23:00:14 user nova-compute[71269]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 23:00:14 user nova-compute[71269]:   <vcpu placement='static'>1</vcpu>
Apr 13 23:00:14 user nova-compute[71269]:   <resource>
Apr 13 23:00:14 user nova-compute[71269]:     <partition>/machine</partition>
Apr 13 23:00:14 user nova-compute[71269]:   </resource>
Apr 13 23:00:14 user nova-compute[71269]:   <sysinfo type='smbios'>
Apr 13 23:00:14 user nova-compute[71269]:     <system>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='version'>0.0.0</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='serial'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='uuid'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='family'>Virtual Machine</entry>
Apr 13 23:00:14 user nova-compute[71269]:     </system>
Apr 13 23:00:14 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:14 user nova-compute[71269]:   <os>
Apr 13 23:00:14 user nova-compute[71269]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 23:00:14 user nova-compute[71269]:     <boot dev='hd'/>
Apr 13 23:00:14 user nova-compute[71269]:     <smbios mode='sysinfo'/>
Apr 13 23:00:14 user nova-compute[71269]:   </os>
Apr 13 23:00:14 user nova-compute[71269]:   <features>
Apr 13 23:00:14 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:14 user nova-compute[71269]:     <apic/>
Apr 13 23:00:14 user nova-compute[71269]:     <vmcoreinfo state='on'/>
Apr 13 23:00:14 user nova-compute[71269]:   </features>
Apr 13 23:00:14 user nova-compute[71269]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 23:00:14 user nova-compute[71269]:     <model fallback='forbid'>Nehalem</model>
Apr 13 23:00:14 user nova-compute[71269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='vme'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='x2apic'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='hypervisor'/>
Apr 13 23:00:14 user nova-compute[71269]:   </cpu>
Apr 13 23:00:14 user nova-compute[71269]:   <clock offset='utc'>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='hpet' present='no'/>
Apr 13 23:00:14 user nova-compute[71269]:   </clock>
Apr 13 23:00:14 user nova-compute[71269]:   <on_poweroff>destroy</on_poweroff>
Apr 13 23:00:14 user nova-compute[71269]:   <on_reboot>restart</on_reboot>
Apr 13 23:00:14 user nova-compute[71269]:   <on_crash>destroy</on_crash>
Apr 13 23:00:14 user nova-compute[71269]:   <devices>
Apr 13 23:00:14 user nova-compute[71269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='disk'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk' index='2'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore type='file' index='3'>
Apr 13 23:00:14 user nova-compute[71269]:         <format type='raw'/>
Apr 13 23:00:14 user nova-compute[71269]:         <source file='/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f'/>
Apr 13 23:00:14 user nova-compute[71269]:         <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       </backingStore>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='vda' bus='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='virtio-disk0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='cdrom'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config' index='1'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='hda' bus='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <readonly/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide0-0-0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='usb' index='0' model='none'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='usb'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='pci.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='ide' index='0'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <interface type='ethernet'>
Apr 13 23:00:14 user nova-compute[71269]:       <mac address='fa:16:3e:4e:57:32'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='tapffc806fb-1b'/>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <mtu size='1442'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='net0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </interface>
Apr 13 23:00:14 user nova-compute[71269]:     <serial type='pty'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='isa-serial' port='0'>
Apr 13 23:00:14 user nova-compute[71269]:         <model name='isa-serial'/>
Apr 13 23:00:14 user nova-compute[71269]:       </target>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </serial>
Apr 13 23:00:14 user nova-compute[71269]:     <console type='pty' tty='/dev/pts/3'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='serial' port='0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </console>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='mouse' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='keyboard' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 23:00:14 user nova-compute[71269]:       <listen type='address' address='0.0.0.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </graphics>
Apr 13 23:00:14 user nova-compute[71269]:     <audio id='1' type='none'/>
Apr 13 23:00:14 user nova-compute[71269]:     <video>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='video0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </video>
Apr 13 23:00:14 user nova-compute[71269]:     <memballoon model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <stats period='10'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='balloon0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:14 user nova-compute[71269]:     <rng model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <backend model='random'>/dev/urandom</backend>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='rng0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </rng>
Apr 13 23:00:14 user nova-compute[71269]:   </devices>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>+64055:+108</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]: </domain>
Apr 13 23:00:14 user nova-compute[71269]:  {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 23:00:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully detached device tap80cfe92e-46 from instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a from the live domain config.
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG os_vif [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80cfe92e-46, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: INFO os_vif [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46')
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:14 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:14</nova:creationTime>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:14 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:14 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:14 user nova-compute[71269]:  {{(pid=71269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-unplugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-unplugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:14 user nova-compute[71269]: WARNING nova.compute.manager [req-5bdf767e-fcd3-47aa-b44b-0a7b00dae38d req-334af35f-121f-46f9-986e-a0f36092f605 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-unplugged-80cfe92e-4656-4479-bb8c-4d66815c678d for instance with vm_state active and task_state None.
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-deleted-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:14 user nova-compute[71269]: INFO nova.compute.manager [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Neutron deleted interface 80cfe92e-4656-4479-bb8c-4d66815c678d; detaching it from the instance and deleting it from the info cache
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquired lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.objects.instance [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Lazy-loading 'system_metadata' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.objects.instance [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Lazy-loading 'flavor' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface>not found in domain: <domain type='kvm' id='20'>
Apr 13 23:00:14 user nova-compute[71269]:   <name>instance-00000010</name>
Apr 13 23:00:14 user nova-compute[71269]:   <uuid>3f6a020c-d8b5-4f6b-a3f0-38287111153a</uuid>
Apr 13 23:00:14 user nova-compute[71269]:   <metadata>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:14 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:14</nova:creationTime>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:14 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:14 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:14 user nova-compute[71269]:   </metadata>
Apr 13 23:00:14 user nova-compute[71269]:   <memory unit='KiB'>131072</memory>
Apr 13 23:00:14 user nova-compute[71269]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 23:00:14 user nova-compute[71269]:   <vcpu placement='static'>1</vcpu>
Apr 13 23:00:14 user nova-compute[71269]:   <resource>
Apr 13 23:00:14 user nova-compute[71269]:     <partition>/machine</partition>
Apr 13 23:00:14 user nova-compute[71269]:   </resource>
Apr 13 23:00:14 user nova-compute[71269]:   <sysinfo type='smbios'>
Apr 13 23:00:14 user nova-compute[71269]:     <system>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='version'>0.0.0</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='serial'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='uuid'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='family'>Virtual Machine</entry>
Apr 13 23:00:14 user nova-compute[71269]:     </system>
Apr 13 23:00:14 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:14 user nova-compute[71269]:   <os>
Apr 13 23:00:14 user nova-compute[71269]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 23:00:14 user nova-compute[71269]:     <boot dev='hd'/>
Apr 13 23:00:14 user nova-compute[71269]:     <smbios mode='sysinfo'/>
Apr 13 23:00:14 user nova-compute[71269]:   </os>
Apr 13 23:00:14 user nova-compute[71269]:   <features>
Apr 13 23:00:14 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:14 user nova-compute[71269]:     <apic/>
Apr 13 23:00:14 user nova-compute[71269]:     <vmcoreinfo state='on'/>
Apr 13 23:00:14 user nova-compute[71269]:   </features>
Apr 13 23:00:14 user nova-compute[71269]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 23:00:14 user nova-compute[71269]:     <model fallback='forbid'>Nehalem</model>
Apr 13 23:00:14 user nova-compute[71269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='vme'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='x2apic'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='hypervisor'/>
Apr 13 23:00:14 user nova-compute[71269]:   </cpu>
Apr 13 23:00:14 user nova-compute[71269]:   <clock offset='utc'>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='hpet' present='no'/>
Apr 13 23:00:14 user nova-compute[71269]:   </clock>
Apr 13 23:00:14 user nova-compute[71269]:   <on_poweroff>destroy</on_poweroff>
Apr 13 23:00:14 user nova-compute[71269]:   <on_reboot>restart</on_reboot>
Apr 13 23:00:14 user nova-compute[71269]:   <on_crash>destroy</on_crash>
Apr 13 23:00:14 user nova-compute[71269]:   <devices>
Apr 13 23:00:14 user nova-compute[71269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='disk'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk' index='2'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore type='file' index='3'>
Apr 13 23:00:14 user nova-compute[71269]:         <format type='raw'/>
Apr 13 23:00:14 user nova-compute[71269]:         <source file='/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f'/>
Apr 13 23:00:14 user nova-compute[71269]:         <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       </backingStore>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='vda' bus='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='virtio-disk0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='cdrom'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config' index='1'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='hda' bus='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <readonly/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide0-0-0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='usb' index='0' model='none'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='usb'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='pci.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='ide' index='0'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <interface type='ethernet'>
Apr 13 23:00:14 user nova-compute[71269]:       <mac address='fa:16:3e:4e:57:32'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='tapffc806fb-1b'/>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <mtu size='1442'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='net0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </interface>
Apr 13 23:00:14 user nova-compute[71269]:     <serial type='pty'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='isa-serial' port='0'>
Apr 13 23:00:14 user nova-compute[71269]:         <model name='isa-serial'/>
Apr 13 23:00:14 user nova-compute[71269]:       </target>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </serial>
Apr 13 23:00:14 user nova-compute[71269]:     <console type='pty' tty='/dev/pts/3'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='serial' port='0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </console>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='mouse' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='keyboard' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 23:00:14 user nova-compute[71269]:       <listen type='address' address='0.0.0.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </graphics>
Apr 13 23:00:14 user nova-compute[71269]:     <audio id='1' type='none'/>
Apr 13 23:00:14 user nova-compute[71269]:     <video>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='video0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </video>
Apr 13 23:00:14 user nova-compute[71269]:     <memballoon model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <stats period='10'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='balloon0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:14 user nova-compute[71269]:     <rng model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <backend model='random'>/dev/urandom</backend>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='rng0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </rng>
Apr 13 23:00:14 user nova-compute[71269]:   </devices>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>+64055:+108</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]: </domain>
Apr 13 23:00:14 user nova-compute[71269]:  {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface> {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:22:d6:4a"/><model type="virtio"/><mtu size="1442"/><target dev="tap80cfe92e-46"/></interface>not found in domain: <domain type='kvm' id='20'>
Apr 13 23:00:14 user nova-compute[71269]:   <name>instance-00000010</name>
Apr 13 23:00:14 user nova-compute[71269]:   <uuid>3f6a020c-d8b5-4f6b-a3f0-38287111153a</uuid>
Apr 13 23:00:14 user nova-compute[71269]:   <metadata>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:14 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:14</nova:creationTime>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:14 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:14 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:14 user nova-compute[71269]:   </metadata>
Apr 13 23:00:14 user nova-compute[71269]:   <memory unit='KiB'>131072</memory>
Apr 13 23:00:14 user nova-compute[71269]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 23:00:14 user nova-compute[71269]:   <vcpu placement='static'>1</vcpu>
Apr 13 23:00:14 user nova-compute[71269]:   <resource>
Apr 13 23:00:14 user nova-compute[71269]:     <partition>/machine</partition>
Apr 13 23:00:14 user nova-compute[71269]:   </resource>
Apr 13 23:00:14 user nova-compute[71269]:   <sysinfo type='smbios'>
Apr 13 23:00:14 user nova-compute[71269]:     <system>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='version'>0.0.0</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='serial'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='uuid'>3f6a020c-d8b5-4f6b-a3f0-38287111153a</entry>
Apr 13 23:00:14 user nova-compute[71269]:       <entry name='family'>Virtual Machine</entry>
Apr 13 23:00:14 user nova-compute[71269]:     </system>
Apr 13 23:00:14 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:14 user nova-compute[71269]:   <os>
Apr 13 23:00:14 user nova-compute[71269]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 23:00:14 user nova-compute[71269]:     <boot dev='hd'/>
Apr 13 23:00:14 user nova-compute[71269]:     <smbios mode='sysinfo'/>
Apr 13 23:00:14 user nova-compute[71269]:   </os>
Apr 13 23:00:14 user nova-compute[71269]:   <features>
Apr 13 23:00:14 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:14 user nova-compute[71269]:     <apic/>
Apr 13 23:00:14 user nova-compute[71269]:     <vmcoreinfo state='on'/>
Apr 13 23:00:14 user nova-compute[71269]:   </features>
Apr 13 23:00:14 user nova-compute[71269]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 23:00:14 user nova-compute[71269]:     <model fallback='forbid'>Nehalem</model>
Apr 13 23:00:14 user nova-compute[71269]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='vme'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='x2apic'/>
Apr 13 23:00:14 user nova-compute[71269]:     <feature policy='require' name='hypervisor'/>
Apr 13 23:00:14 user nova-compute[71269]:   </cpu>
Apr 13 23:00:14 user nova-compute[71269]:   <clock offset='utc'>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 23:00:14 user nova-compute[71269]:     <timer name='hpet' present='no'/>
Apr 13 23:00:14 user nova-compute[71269]:   </clock>
Apr 13 23:00:14 user nova-compute[71269]:   <on_poweroff>destroy</on_poweroff>
Apr 13 23:00:14 user nova-compute[71269]:   <on_reboot>restart</on_reboot>
Apr 13 23:00:14 user nova-compute[71269]:   <on_crash>destroy</on_crash>
Apr 13 23:00:14 user nova-compute[71269]:   <devices>
Apr 13 23:00:14 user nova-compute[71269]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='disk'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk' index='2'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore type='file' index='3'>
Apr 13 23:00:14 user nova-compute[71269]:         <format type='raw'/>
Apr 13 23:00:14 user nova-compute[71269]:         <source file='/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f'/>
Apr 13 23:00:14 user nova-compute[71269]:         <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       </backingStore>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='vda' bus='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='virtio-disk0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <disk type='file' device='cdrom'>
Apr 13 23:00:14 user nova-compute[71269]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 23:00:14 user nova-compute[71269]:       <source file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk.config' index='1'/>
Apr 13 23:00:14 user nova-compute[71269]:       <backingStore/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='hda' bus='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <readonly/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide0-0-0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </disk>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='usb' index='0' model='none'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='usb'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='pci.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <controller type='ide' index='0'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='ide'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </controller>
Apr 13 23:00:14 user nova-compute[71269]:     <interface type='ethernet'>
Apr 13 23:00:14 user nova-compute[71269]:       <mac address='fa:16:3e:4e:57:32'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target dev='tapffc806fb-1b'/>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio'/>
Apr 13 23:00:14 user nova-compute[71269]:       <mtu size='1442'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='net0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </interface>
Apr 13 23:00:14 user nova-compute[71269]:     <serial type='pty'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='isa-serial' port='0'>
Apr 13 23:00:14 user nova-compute[71269]:         <model name='isa-serial'/>
Apr 13 23:00:14 user nova-compute[71269]:       </target>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </serial>
Apr 13 23:00:14 user nova-compute[71269]:     <console type='pty' tty='/dev/pts/3'>
Apr 13 23:00:14 user nova-compute[71269]:       <source path='/dev/pts/3'/>
Apr 13 23:00:14 user nova-compute[71269]:       <log file='/opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/console.log' append='off'/>
Apr 13 23:00:14 user nova-compute[71269]:       <target type='serial' port='0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='serial0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </console>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='mouse' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <input type='keyboard' bus='ps2'>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='input1'/>
Apr 13 23:00:14 user nova-compute[71269]:     </input>
Apr 13 23:00:14 user nova-compute[71269]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Apr 13 23:00:14 user nova-compute[71269]:       <listen type='address' address='0.0.0.0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </graphics>
Apr 13 23:00:14 user nova-compute[71269]:     <audio id='1' type='none'/>
Apr 13 23:00:14 user nova-compute[71269]:     <video>
Apr 13 23:00:14 user nova-compute[71269]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='video0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </video>
Apr 13 23:00:14 user nova-compute[71269]:     <memballoon model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <stats period='10'/>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='balloon0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:14 user nova-compute[71269]:     <rng model='virtio'>
Apr 13 23:00:14 user nova-compute[71269]:       <backend model='random'>/dev/urandom</backend>
Apr 13 23:00:14 user nova-compute[71269]:       <alias name='rng0'/>
Apr 13 23:00:14 user nova-compute[71269]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 23:00:14 user nova-compute[71269]:     </rng>
Apr 13 23:00:14 user nova-compute[71269]:   </devices>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>libvirt-3f6a020c-d8b5-4f6b-a3f0-38287111153a</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 23:00:14 user nova-compute[71269]:     <label>+64055:+108</label>
Apr 13 23:00:14 user nova-compute[71269]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 23:00:14 user nova-compute[71269]:   </seclabel>
Apr 13 23:00:14 user nova-compute[71269]: </domain>
Apr 13 23:00:14 user nova-compute[71269]:  {{(pid=71269) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 23:00:14 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Detaching interface fa:16:3e:22:d6:4a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap80cfe92e-46' not found.
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Converting VIF {"id": "80cfe92e-4656-4479-bb8c-4d66815c678d", "address": "fa:16:3e:22:d6:4a", "network": {"id": "10f8036f-dce2-47ad-ac84-e35492d93722", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-231204869", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80cfe92e-46", "ovs_interfaceid": "80cfe92e-4656-4479-bb8c-4d66815c678d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG os_vif [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80cfe92e-46, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:14 user nova-compute[71269]: INFO os_vif [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d6:4a,bridge_name='br-int',has_traffic_filtering=True,id=80cfe92e-4656-4479-bb8c-4d66815c678d,network=Network(10f8036f-dce2-47ad-ac84-e35492d93722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80cfe92e-46')
Apr 13 23:00:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [req-ad2713b4-76ee-471e-a542-fabc3495523f req-2aa4851b-f12a-4362-96ad-87ef1ebf5eb3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:14 user nova-compute[71269]:   <nova:package version="0.0.0"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:name>tempest-device-tagging-server-320023131</nova:name>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:creationTime>2023-04-13 23:00:14</nova:creationTime>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:flavor name="m1.nano">
Apr 13 23:00:14 user nova-compute[71269]:     <nova:memory>128</nova:memory>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:disk>1</nova:disk>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:swap>0</nova:swap>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:flavor>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:user uuid="9ec0b2d09be54070ab00037165788f8a">tempest-TaggedAttachmentsTest-1196616995-project-member</nova:user>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:project uuid="f8b1ce9b9f4d4adf8316110aae9e04d7">tempest-TaggedAttachmentsTest-1196616995</nova:project>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:owner>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:14 user nova-compute[71269]:   <nova:ports>
Apr 13 23:00:14 user nova-compute[71269]:     <nova:port uuid="ffc806fb-1b25-492f-b786-27222f795160">
Apr 13 23:00:14 user nova-compute[71269]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:14 user nova-compute[71269]:     </nova:port>
Apr 13 23:00:14 user nova-compute[71269]:   </nova:ports>
Apr 13 23:00:14 user nova-compute[71269]: </nova:instance>
Apr 13 23:00:14 user nova-compute[71269]:  {{(pid=71269) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 23:00:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [{"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Releasing lock "refresh_cache-3f6a020c-d8b5-4f6b-a3f0-38287111153a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3f2e071-8c35-4054-bd2c-d96d8b692734 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "interface-3f6a020c-d8b5-4f6b-a3f0-38287111153a-80cfe92e-4656-4479-bb8c-4d66815c678d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.470s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:16 user nova-compute[71269]: WARNING nova.compute.manager [req-28afdb5e-455b-4d42-8e98-95b23aac52ef req-28786f36-bf7e-4e6b-9f6c-200869a49651 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-80cfe92e-4656-4479-bb8c-4d66815c678d for instance with vm_state active and task_state None.
Apr 13 23:00:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:00:28 user nova-compute[71269]: INFO nova.compute.claims [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Claim successful on node user
Apr 13 23:00:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:00:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:00:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:00:29 user nova-compute[71269]: INFO nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Booting with volume 748dfe3c-bd51-40d5-b219-46a5183d5d78 at /dev/vda
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2866ce-1269-4042-aa4f-ce2979c976e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG nova.policy [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c16f28e6923c4fbfbb3c295377b6f9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3774169387c4fc59f3300af1a033087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb50725-5292-484c-9076-2985f3248324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d703081-4aef-45ba-b29f-478e726e649d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9547c308-59a9-4539-91c6-07be01c350a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:29 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:00:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c99d07-7b6d-478a-9adc-930dbb3e2775]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating existing volume attachment record: b6eb3eb4-c8ac-4005-8f12-3a60a7940468 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully created port: 302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully created port: d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully created port: 7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:32 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully created port: b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully created port: 20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:00:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:33 user nova-compute[71269]: INFO nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Booting with volume af258cda-4dd1-4033-92da-e5227f03ab77 at /dev/vdb
Apr 13 23:00:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: 302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99dff7d-ef7d-4a97-bcc3-f0932e156c01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-302fbc22-4c9a-48dc-bf40-4aec87dd4b92. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdfded8-042a-4a47-9ae9-cdb03c2b1b7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2e04b-51c7-417c-a917-51fe3caf5bda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3fcbc-26f3-46f3-9742-854392cf8ddb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:34 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c94c1-7f2e-4cdb-8daa-a96fbba9b61d]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating existing volume attachment record: 5446ce0c-0f0b-4a4d-83b7-4a4114970fc4 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'info_cache' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2b59a379-60a9-4508-818f-daa874f55bff req-cb161c91-5db4-42e9-abb5-06f2491eda8d service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: 693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance destroyed successfully.
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'resources' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG os_vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c47f47-2e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:35 user nova-compute[71269]: INFO os_vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start _get_guest_xml network_info=[{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'numa_topology' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:35 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:35 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:00:35 user nova-compute[71269]:   <uuid>92e1fa88-8896-4198-af4d-56d44baf3b9b</uuid>
Apr 13 23:00:35 user nova-compute[71269]:   <name>instance-00000003</name>
Apr 13 23:00:35 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:00:35 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:00:35 user nova-compute[71269]:   <metadata>
Apr 13 23:00:35 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:35 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeTestJSON-server-399970293</nova:name>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:00:35</nova:creationTime>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:00:35 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:35 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:owner>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:user uuid="13b46af525dd45678b69207e93683ac4">tempest-AttachVolumeTestJSON-118072319-project-member</nova:user>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:project uuid="d0648ea953174a8cae6085ac24d92bb1">tempest-AttachVolumeTestJSON-118072319</nova:project>
Apr 13 23:00:35 user nova-compute[71269]:       </nova:owner>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:35 user nova-compute[71269]:       <nova:ports>
Apr 13 23:00:35 user nova-compute[71269]:         <nova:port uuid="94c47f47-2ee7-46d0-858d-a5ff3270a80b">
Apr 13 23:00:35 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:00:35 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:35 user nova-compute[71269]:       </nova:ports>
Apr 13 23:00:35 user nova-compute[71269]:     </nova:instance>
Apr 13 23:00:35 user nova-compute[71269]:   </metadata>
Apr 13 23:00:35 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:00:35 user nova-compute[71269]:     <system>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="serial">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="uuid">92e1fa88-8896-4198-af4d-56d44baf3b9b</entry>
Apr 13 23:00:35 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:00:35 user nova-compute[71269]:     </system>
Apr 13 23:00:35 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:35 user nova-compute[71269]:   <os>
Apr 13 23:00:35 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:00:35 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:00:35 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:00:35 user nova-compute[71269]:   </os>
Apr 13 23:00:35 user nova-compute[71269]:   <features>
Apr 13 23:00:35 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:35 user nova-compute[71269]:     <apic/>
Apr 13 23:00:35 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:00:35 user nova-compute[71269]:   </features>
Apr 13 23:00:35 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:00:35 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:00:35 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:00:35 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:00:35 user nova-compute[71269]:   </clock>
Apr 13 23:00:35 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:00:35 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:00:35 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:00:35 user nova-compute[71269]:   </cpu>
Apr 13 23:00:35 user nova-compute[71269]:   <devices>
Apr 13 23:00:35 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:00:35 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:00:35 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk"/>
Apr 13 23:00:35 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:00:35 user nova-compute[71269]:     </disk>
Apr 13 23:00:35 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:35 user nova-compute[71269]:       <mac address="fa:16:3e:03:14:a3"/>
Apr 13 23:00:35 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:35 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:35 user nova-compute[71269]:       <target dev="tap94c47f47-2e"/>
Apr 13 23:00:35 user nova-compute[71269]:     </interface>
Apr 13 23:00:35 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:00:35 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/console.log" append="off"/>
Apr 13 23:00:35 user nova-compute[71269]:     </serial>
Apr 13 23:00:35 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:00:35 user nova-compute[71269]:     <video>
Apr 13 23:00:35 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:35 user nova-compute[71269]:     </video>
Apr 13 23:00:35 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:00:35 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:00:35 user nova-compute[71269]:     </rng>
Apr 13 23:00:35 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:00:35 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:00:35 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:00:35 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:35 user nova-compute[71269]:   </devices>
Apr 13 23:00:35 user nova-compute[71269]: </domain>
Apr 13 23:00:35 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: 5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-693e2c7e-e759-4e34-a3fb-ef2e51eecaca. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Cannot resize image /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'migration_context' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG os_vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c47f47-2e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94c47f47-2e, col_values=(('external_ids', {'iface-id': '94c47f47-2ee7-46d0-858d-a5ff3270a80b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:14:a3', 'vm-uuid': '92e1fa88-8896-4198-af4d-56d44baf3b9b'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:36 user nova-compute[71269]: INFO os_vif [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-5d649918-bdcb-4b16-b701-1dbad3722881. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:36 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG nova.network.neutron [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-894de12b-ccb1-4b36-84b5-ceb3d022fcf1 req-944f9b83-0d24-49f1-b615-085b270e5265 service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:37 user nova-compute[71269]: WARNING nova.compute.manager [req-61076a12-1420-4461-974a-0ef80f0b9278 req-ce1c38cc-906f-47e4-a40b-22b0be818b6f service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state stopped and task_state powering-on.
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-d7199650-e2d2-4349-af5f-357b9f511835. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:38 user nova-compute[71269]: INFO nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Booting with volume 5bc7e45c-5d77-4435-81cc-54d2f33bcd71 at /dev/vdc
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-22d6f9f6-94d5-4f53-91db-2a99febea7ba req-b587551e-da59-4a90-b4d2-767b28797cda service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[07651f1d-2018-4cac-b848-69448d145225]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef93248-cc6b-48be-a096-2b6234a6d679]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: 7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd0e1d1-b873-4848-9e5f-45c6de84b9ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577c97d-ef0f-4387-b600-78f61b65fafc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:00:38 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:00:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c46153-4798-4ce0-bafd-ed5ca3578b4f]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG os_brick.utils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:38 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating existing volume attachment record: efb65a62-092a-4987-b74f-019e72ed30aa {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426839.766076, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:00:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Resumed (Lifecycle Event)
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:00:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance rebooted successfully.
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-eafc3136-7d6f-42a5-81d9-d1e97cee5a10 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:00:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426839.7710078, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:00:39 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Started (Lifecycle Event)
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:39 user nova-compute[71269]: WARNING nova.compute.manager [req-7dc22af8-b4ac-4582-9b5e-9b7d6e5a70cd req-426ef58a-c7c2-4e3a-b56c-9e13de749ddc service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state active and task_state None.
Apr 13 23:00:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Successfully updated port: 20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-7e8b103f-6a1d-41f9-aab0-8c17817026a5. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance network_info: |[{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updated VIF entry in instance network info cache for port 7e8b103f-6a1d-41f9-aab0-8c17817026a5. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-b5c60c56-d874-48fe-be4f-5dd41322809f. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:00:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Creating image(s)
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Ensure instance console log exists: /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Start _get_guest_xml network_info=[{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b6eb3eb4-c8ac-4005-8f12-3a60a7940468', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBAvlSFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa', 'attached_at': '', 'detached_at': '', 'volume_id': '748dfe3c-bd51-40d5-b219-46a5183d5d78', 'serial': '748dfe3c-bd51-40d5-b219-46a5183d5d78'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '5446ce0c-0f0b-4a4d-83b7-4a4114970fc4', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYHnwRck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'af258cda-4dd1-4033-92da-e5227f03ab77', 'serial': 'af258cda-4dd1-4033-92da-e5227f03ab77'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'efb65a62-092a-4987-b74f-019e72ed30aa', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnQrOoUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa', 'attached_at': '', 'detached_at': '', 'volume_id': '5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 'serial': '5bc7e45c-5d77-4435-81cc-54d2f33bcd71'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:00:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBAvlSFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:43 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba0658-4eed-4b1a-aad1-603d99be49ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:00:43 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f799e1-f30c-4dc6-b027-cf8e791bba31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78] added
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44daeb0b-fd90-4892-bd6c-e76f108f6dac]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updated VIF entry in instance network info cache for port b5c60c56-d874-48fe-be4f-5dd41322809f. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1cb1e-5d95-4363-9a1d-5038987be702]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBAvlSFU {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBAvlSFU" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51d3f2-64a2-4f29-892c-300a17b1776f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBAvlSFU'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-20766522-a6dc-49b0-a925-09cbcce46937. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff90d43-f2b2-4866-9292-19d18386dad9]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4c1bb4-01a9-4b0d-bb26-dcfdae87fcbd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f481aeae-082c-4b87-a9c5-c5a71b51cf0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260]
Apr 13 23:00:43 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[11093a17-d209-4d47-8473-ec820fc27065]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87527ef0-cf73-4ff4-879c-215f67fb7b6d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de7bf7-d6be-4eb4-9bf8-038c49503300]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:00:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBAvlSFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updated VIF entry in instance network info cache for port 20766522-a6dc-49b0-a925-09cbcce46937. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG nova.network.neutron [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-153e4aec-5f10-4ab9-a59f-d64fc3dcc2bd req-fe63390f-25c2-4fbb-a3b5-da4c10cadad1 service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23931656331393135', 'path': '/dev/sdf'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931656331393135', 'path': '/dev/sdf'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYHnwRck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:44 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:44 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:44 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[53156384-3e4b-4930-8a84-8049d3c4e597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:00:44 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01ca25-b378-4481-bd2c-a50a5ad60de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77] added
Apr 13 23:00:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[572d03a9-e2cd-4f7a-9723-ec4cdf067502]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f675fd2-9b04-4795-ac27-fae611f1b48b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYHnwRck {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYHnwRck" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b1b2c-b7cc-4c4b-80c8-0326e1e0400f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYHnwRck'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce48fe1-7420-4216-bcf6-c7b68a206f45]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[799d003a-f1e0-4bb1-a65f-5e9b3ac34138]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[858dc5b5-aeeb-452a-839a-b9468a76a271]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260]
Apr 13 23:00:45 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:45 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac0c84-777e-43d2-a516-14ad95bf584c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e98ae-0462-4ccc-9573-838b4a58d2e6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:45 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ffe8d8-78cd-409b-9c14-94c1cbd9d87d]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:00:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYHnwRck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26237613036383362', 'path': '/dev/sdg'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237613036383362', 'path': '/dev/sdg'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnQrOoUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:46 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:46 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:46 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d66afa-aba1-40b0-bbc4-91d598a0159d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:00:46 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[85065270-25f3-4ddf-982b-6502262b0343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71] added
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae464b-2605-4c6f-b49b-1e1f36438c8c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe076379-0eac-4768-b77e-4be8bc9f8c5b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnQrOoUJ {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnQrOoUJ" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[36adce3c-c3b1-4d56-8bfd-16e4e98cec1e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gnQrOoUJ'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3192b99-c6b1-4d5d-887b-e95bf4428e69]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7525c-ca71-4803-9d45-9370e7d5657d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c93f9-0d3d-4abc-89ee-294585148d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260]
Apr 13 23:00:46 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65d87b-6944-426e-a66d-57f349a7b25f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa6264-177c-4718-8d37-416853d0be3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:46 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3701d550-c564-4ab9-93cd-d836b383ec23]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:00:46 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnQrOoUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:47 user nova-compute[71269]: INFO nova.compute.manager [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Terminating instance
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26134383032626533', 'path': '/dev/sdh'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383032626533', 'path': '/dev/sdh'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lazy-loading 'pci_devices' on Instance uuid 1783d976-5b1b-466b-abb1-fd4b5c9c01aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:00:47 user nova-compute[71269]:   <uuid>1783d976-5b1b-466b-abb1-fd4b5c9c01aa</uuid>
Apr 13 23:00:47 user nova-compute[71269]:   <name>instance-00000014</name>
Apr 13 23:00:47 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:00:47 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:00:47 user nova-compute[71269]:   <metadata>
Apr 13 23:00:47 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:00:47 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:name>tempest-device-tagging-server-1085018677</nova:name>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:00:43</nova:creationTime>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:00:47 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:00:47 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:owner>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:user uuid="c16f28e6923c4fbfbb3c295377b6f9d8">tempest-TaggedBootDevicesTest-2028021468-project-member</nova:user>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:project uuid="a3774169387c4fc59f3300af1a033087">tempest-TaggedBootDevicesTest-2028021468</nova:project>
Apr 13 23:00:47 user nova-compute[71269]:       </nova:owner>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:00:47 user nova-compute[71269]:       <nova:ports>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="302fbc22-4c9a-48dc-bf40-4aec87dd4b92">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="693e2c7e-e759-4e34-a3fb-ef2e51eecaca">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="5d649918-bdcb-4b16-b701-1dbad3722881">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="d7199650-e2d2-4349-af5f-357b9f511835">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="7e8b103f-6a1d-41f9-aab0-8c17817026a5">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="b5c60c56-d874-48fe-be4f-5dd41322809f">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:         <nova:port uuid="20766522-a6dc-49b0-a925-09cbcce46937">
Apr 13 23:00:47 user nova-compute[71269]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 23:00:47 user nova-compute[71269]:         </nova:port>
Apr 13 23:00:47 user nova-compute[71269]:       </nova:ports>
Apr 13 23:00:47 user nova-compute[71269]:     </nova:instance>
Apr 13 23:00:47 user nova-compute[71269]:   </metadata>
Apr 13 23:00:47 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:00:47 user nova-compute[71269]:     <system>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="serial">1783d976-5b1b-466b-abb1-fd4b5c9c01aa</entry>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="uuid">1783d976-5b1b-466b-abb1-fd4b5c9c01aa</entry>
Apr 13 23:00:47 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:00:47 user nova-compute[71269]:     </system>
Apr 13 23:00:47 user nova-compute[71269]:   </sysinfo>
Apr 13 23:00:47 user nova-compute[71269]:   <os>
Apr 13 23:00:47 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:00:47 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:00:47 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:00:47 user nova-compute[71269]:   </os>
Apr 13 23:00:47 user nova-compute[71269]:   <features>
Apr 13 23:00:47 user nova-compute[71269]:     <acpi/>
Apr 13 23:00:47 user nova-compute[71269]:     <apic/>
Apr 13 23:00:47 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:00:47 user nova-compute[71269]:   </features>
Apr 13 23:00:47 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:00:47 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:00:47 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:00:47 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:00:47 user nova-compute[71269]:   </clock>
Apr 13 23:00:47 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:00:47 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:00:47 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:00:47 user nova-compute[71269]:   </cpu>
Apr 13 23:00:47 user nova-compute[71269]:   <devices>
Apr 13 23:00:47 user nova-compute[71269]:     <disk type="file" device="cdrom">
Apr 13 23:00:47 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 23:00:47 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/disk.config"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="hda" bus="ide"/>
Apr 13 23:00:47 user nova-compute[71269]:     </disk>
Apr 13 23:00:47 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:00:47 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:47 user nova-compute[71269]:       <source dev="/dev/sdf"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <serial>748dfe3c-bd51-40d5-b219-46a5183d5d78</serial>
Apr 13 23:00:47 user nova-compute[71269]:     </disk>
Apr 13 23:00:47 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:00:47 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:47 user nova-compute[71269]:       <source dev="/dev/sdg"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <serial>af258cda-4dd1-4033-92da-e5227f03ab77</serial>
Apr 13 23:00:47 user nova-compute[71269]:     </disk>
Apr 13 23:00:47 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:00:47 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:47 user nova-compute[71269]:       <source dev="/dev/sdh"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="vdc" bus="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <serial>5bc7e45c-5d77-4435-81cc-54d2f33bcd71</serial>
Apr 13 23:00:47 user nova-compute[71269]:     </disk>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:47:5d:da"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tap302fbc22-4c"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:12:8c:af"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tap693e2c7e-e7"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:b3:1b:ce"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tap5d649918-bd"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:6b:fd:11"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tapd7199650-e2"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:68:ce:ba"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tap7e8b103f-6a"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:ce:18:51"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tapb5c60c56-d8"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:00:47 user nova-compute[71269]:       <mac address="fa:16:3e:8f:bc:42"/>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:00:47 user nova-compute[71269]:       <target dev="tap20766522-a6"/>
Apr 13 23:00:47 user nova-compute[71269]:     </interface>
Apr 13 23:00:47 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:00:47 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/console.log" append="off"/>
Apr 13 23:00:47 user nova-compute[71269]:     </serial>
Apr 13 23:00:47 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:00:47 user nova-compute[71269]:     <video>
Apr 13 23:00:47 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:00:47 user nova-compute[71269]:     </video>
Apr 13 23:00:47 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:00:47 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:00:47 user nova-compute[71269]:     </rng>
Apr 13 23:00:47 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:00:47 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:00:47 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:00:47 user nova-compute[71269]:     </memballoon>
Apr 13 23:00:47 user nova-compute[71269]:   </devices>
Apr 13 23:00:47 user nova-compute[71269]: </domain>
Apr 13 23:00:47 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-unplugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] No waiting events found dispatching network-vif-unplugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-a1a3a545-56cc-4834-80eb-5918c5f33372 req-e60eaf4b-cd87-4e27-be94-0653e0c59d8d service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-unplugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap302fbc22-4c, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap302fbc22-4c, col_values=(('external_ids', {'iface-id': '302fbc22-4c9a-48dc-bf40-4aec87dd4b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:5d:da', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c')
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693e2c7e-e7, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap693e2c7e-e7, col_values=(('external_ids', {'iface-id': '693e2c7e-e759-4e34-a3fb-ef2e51eecaca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:8c:af', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7')
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d649918-bd, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d649918-bd, col_values=(('external_ids', {'iface-id': '5d649918-bdcb-4b16-b701-1dbad3722881', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:1b:ce', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd')
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7199650-e2, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7199650-e2, col_values=(('external_ids', {'iface-id': 'd7199650-e2d2-4349-af5f-357b9f511835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:fd:11', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2')
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8b103f-6a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8b103f-6a, col_values=(('external_ids', {'iface-id': '7e8b103f-6a1d-41f9-aab0-8c17817026a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:ce:ba', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a')
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5c60c56-d8, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5c60c56-d8, col_values=(('external_ids', {'iface-id': 'b5c60c56-d874-48fe-be4f-5dd41322809f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:18:51', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:47 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8')
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20766522-a6, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20766522-a6, col_values=(('external_ids', {'iface-id': '20766522-a6dc-49b0-a925-09cbcce46937', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:bc:42', 'vm-uuid': '1783d976-5b1b-466b-abb1-fd4b5c9c01aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: INFO os_vif [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6')
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Instance destroyed successfully.
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid bc51e254-7d38-49f6-816e-947d92f95950 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-853709521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-853709521',id=17,image_ref='7119a410-f029-4b60-b10c-446ba970d825',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:59:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-8woyu865',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-751187467',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:15Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=bc51e254-7d38-49f6-816e-947d92f95950,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "address": "fa:16:3e:1b:ee:d2", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06270a1-7c", "ovs_interfaceid": "b06270a1-7c20-4d1a-98b7-4dafc26585e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_vif [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb06270a1-7c, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] No BDM found with device name hda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] No VIF found with MAC fa:16:3e:47:5d:da, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] No VIF found with MAC fa:16:3e:68:ce:ba, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Using config drive
Apr 13 23:00:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:48 user nova-compute[71269]: INFO os_vif [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ee:d2,bridge_name='br-int',has_traffic_filtering=True,id=b06270a1-7c20-4d1a-98b7-4dafc26585e2,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06270a1-7c')
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJEBcGNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:48 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62147895-1c1b-49a1-8bd6-a188546d6d89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:00:48 user nova-compute[71269]: No targets found.
Apr 13 23:00:48 user nova-compute[71269]: iSNS:
Apr 13 23:00:48 user nova-compute[71269]: No targets found.
Apr 13 23:00:48 user nova-compute[71269]: STATIC:
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 23:00:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:48 user nova-compute[71269]: FIRMWARE:
Apr 13 23:00:48 user nova-compute[71269]: No targets found.
Apr 13 23:00:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:00:48 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:00:48 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d3a9a-3956-4a04-ace4-50397ec9ea20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f935927-8243-4ff3-bad5-d62f0e137b36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Creating config drive at /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/disk.config
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxzzrsm1b {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e4c4f-76f4-4d5f-a7a4-53bd62745613]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxzzrsm1b" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3a792-e6e3-485f-b267-50ca99f5738d]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abc495e-84bb-4d99-b89d-5279fc8c8bc4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62ac548-5220-4470-b613-48606bbe5fef]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b03932-78e0-40b5-b147-17a0b2886979]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b26a11-39f0-4314-beb3-479ea2e473a0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260]
Apr 13 23:00:48 user nova-compute[71269]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a6619c-59e3-4466-ac79-e89a7ce63e4c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (484ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Deleting instance files /opt/stack/data/nova/instances/bc51e254-7d38-49f6-816e-947d92f95950_del
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Deletion of /opt/stack/data/nova/instances/bc51e254-7d38-49f6-816e-947d92f95950_del complete
Apr 13 23:00:48 user nova-compute[71269]: INFO nova.compute.manager [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Took 1.49 seconds to destroy the instance on the hypervisor.
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:49 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid 'bc51e254-7d38-49f6-816e-947d92f95950' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid 'bc51e254-7d38-49f6-816e-947d92f95950' (instance-00000011)
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:49 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Took 0.75 seconds to deallocate network for instance.
Apr 13 23:00:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Acquiring lock "bc51e254-7d38-49f6-816e-947d92f95950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] Lock "bc51e254-7d38-49f6-816e-947d92f95950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] No waiting events found dispatching network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:49 user nova-compute[71269]: WARNING nova.compute.manager [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received unexpected event network-vif-plugged-b06270a1-7c20-4d1a-98b7-4dafc26585e2 for instance with vm_state active and task_state deleting.
Apr 13 23:00:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-63b7ff98-9ef6-48fb-bfb4-97d53a958b9e req-c7f304fe-ebdf-4ff4-b70a-0f56e34150e1 service nova] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Received event network-vif-deleted-b06270a1-7c20-4d1a-98b7-4dafc26585e2 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:50 user nova-compute[71269]: WARNING nova.compute.manager [req-616b9a87-cb20-45e3-9eae-0d2e531b2f35 req-cbf80165-3f52-46ea-85c9-b9be0442888b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance with vm_state building and task_state spawning.
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:50 user nova-compute[71269]: WARNING nova.compute.manager [req-4d40823c-fcc1-4752-b069-8a837c2ae5b9 req-ad957eb2-2668-4773-99c2-d42c36eb3405 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance with vm_state building and task_state spawning.
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: INFO nova.compute.manager [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Took 1.09 seconds to detach 1 volumes for instance.
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Deleting volume: 84b051b7-4bd2-4ee8-ba2a-f21e6be0c5c2 {{(pid=71269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:51 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance bc51e254-7d38-49f6-816e-947d92f95950
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b2d8c7d-0738-46f7-b5e7-136ba471bd05 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "bc51e254-7d38-49f6-816e-947d92f95950" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.290s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:51 user nova-compute[71269]: WARNING nova.compute.manager [req-2fa60efb-6367-4644-9759-fb3bd5b723aa req-b5eca620-f3dd-4269-a384-d4d9802195ea service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 for instance with vm_state building and task_state spawning.
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-b8b82784-bb75-4582-9fb9-b215a39103af req-4881c6dc-8680-42f8-846b-c5da58ffe559 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:52 user nova-compute[71269]: WARNING nova.compute.manager [req-f9a95303-df9a-4c92-8193-a4f3cec2aa62 req-cf2419ee-dc1c-49ef-a201-a2c59e210d47 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 for instance with vm_state building and task_state spawning.
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:53 user nova-compute[71269]: WARNING nova.compute.manager [req-adee46c5-f17f-4d6d-8049-2d5229ff0e03 req-79a09406-0982-4cbc-ae7e-21facd664fd4 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 for instance with vm_state building and task_state spawning.
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426854.4291763, 1783d976-5b1b-466b-abb1-fd4b5c9c01aa => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] VM Resumed (Lifecycle Event)
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:54 user nova-compute[71269]: WARNING nova.compute.manager [req-36655244-bb20-4214-b768-e09075b6965a req-8f29977a-2ccf-403f-a99f-131b8d1b1f8b service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f for instance with vm_state building and task_state spawning.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:00:54 user nova-compute[71269]: WARNING nova.compute.manager [req-25d5bdd2-ac95-4b88-94b6-47df1b0358fb req-133edf98-d16c-427f-86e5-0f9270f7a2d9 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 for instance with vm_state building and task_state spawning.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:00:54 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:54 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=26.416362762451172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance spawned successfully.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426854.4309356, 1783d976-5b1b-466b-abb1-fd4b5c9c01aa => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] VM Started (Lifecycle Event)
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b190941d-9f62-41ef-881d-e02d246e9138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:00:54 user nova-compute[71269]: INFO nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Took 11.57 seconds to spawn the instance on the hypervisor.
Apr 13 23:00:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:00:55 user nova-compute[71269]: INFO nova.compute.manager [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Took 26.65 seconds to build instance.
Apr 13 23:00:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3b6d1eae-d21b-4c77-b5c5-81d248cb5c18 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.783s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:55 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:00:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:00:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:00:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing instance network info cache due to event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.network.neutron [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.network.neutron [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updated VIF entry in instance network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG nova.network.neutron [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a01cea87-0a08-4ce9-b559-2b92c2767aa1 req-cc1377bd-7d91-41e5-88f5-bbd0d6602918 service nova] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing instance network info cache due to event network-changed-37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Acquiring lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Acquired lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Refreshing network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:00:58 user nova-compute[71269]: INFO nova.compute.manager [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Detaching volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 23:00:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:58 user nova-compute[71269]: INFO nova.virt.block_device [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Attempting to driver detach volume 31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c from mountpoint /dev/vdb
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Attempting to detach device vdb from instance b190941d-9f62-41ef-881d-e02d246e9138 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:00:58 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:58 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:00:58 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:00:58 user nova-compute[71269]:   <serial>31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c</serial>
Apr 13 23:00:58 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:00:58 user nova-compute[71269]: </disk>
Apr 13 23:00:58 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully detached device vdb from instance b190941d-9f62-41ef-881d-e02d246e9138 from the persistent domain config.
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b190941d-9f62-41ef-881d-e02d246e9138 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:00:58 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:00:58 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:00:58 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:00:58 user nova-compute[71269]:   <serial>31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c</serial>
Apr 13 23:00:58 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:00:58 user nova-compute[71269]: </disk>
Apr 13 23:00:58 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [{"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-92e1fa88-8896-4198-af4d-56d44baf3b9b" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updated VIF entry in instance network info cache for port 37865aaf-d7fb-4f6b-b764-2b75e9d3e924. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [{"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f829846-34fd-4aca-875f-ef8f28441fbc req-c5cb2be9-54ac-4491-8b1a-6039ff986b6a service nova] Releasing lock "refresh_cache-b190941d-9f62-41ef-881d-e02d246e9138" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426858.7682521, b190941d-9f62-41ef-881d-e02d246e9138 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:00:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully detached device vdb from instance b190941d-9f62-41ef-881d-e02d246e9138 from the live domain config.
Apr 13 23:00:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxklcSDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:00:58 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49092dda-0504-4c93-b1af-ac90ba3278fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:00:58 user nova-compute[71269]: No targets found.
Apr 13 23:00:58 user nova-compute[71269]: iSNS:
Apr 13 23:00:58 user nova-compute[71269]: No targets found.
Apr 13 23:00:58 user nova-compute[71269]: STATIC:
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c
Apr 13 23:00:58 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:00:58 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:00:58 user nova-compute[71269]: FIRMWARE:
Apr 13 23:00:58 user nova-compute[71269]: No targets found.
Apr 13 23:00:58 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:00:58 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:00:58 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04065b1e-e633-4eae-8416-ebb6f98269f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c084c60e-4ea0-4215-acdc-cd3b0bafe934]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:00:58 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc7b9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111572c-fb3d-4e74-ab58-1af79c3b035a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865c48e-4f58-400e-be72-545240503de5]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee314423-f5e2-415d-ae3b-4215adb96a1f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:00:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa7bf1-273e-4cf0-a1e1-e86ae910d005]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25581e-18d9-4bdb-9f01-94d69bc9594b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b955a7-400d-4af5-9449-c5f0643a39be]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260]
Apr 13 23:00:59 user nova-compute[71269]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c, portal: 172.16.0.220,3260] successful.
Apr 13 23:00:59 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31792dcc-e06b-4b26-a8ca-3e9ac0aa8c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19cdb92-5551-456a-9426-2de2422da960]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== disconnect_volume: return (370ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:00:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:01:00 user nova-compute[71269]: DEBUG nova.objects.instance [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-90bf8ad2-7bf8-461a-87dc-18c6724a0fce tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:03 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426848.1225276, bc51e254-7d38-49f6-816e-947d92f95950 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:03 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: bc51e254-7d38-49f6-816e-947d92f95950] VM Stopped (Lifecycle Event)
Apr 13 23:01:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e114b5d0-0a4a-4726-951e-41f9c565e119 None None] [instance: bc51e254-7d38-49f6-816e-947d92f95950] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:04 user nova-compute[71269]: INFO nova.compute.manager [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Terminating instance
Apr 13 23:01:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-unplugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-unplugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-7ea9aba8-ec99-4531-895c-d33ee94a7b5e req-fc8b9368-86a3-4903-8359-9df694a6494b service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-unplugged-ffc806fb-1b25-492f-b786-27222f795160 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:01:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Instance destroyed successfully.
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lazy-loading 'resources' on Instance uuid 3f6a020c-d8b5-4f6b-a3f0-38287111153a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T22:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-320023131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-320023131',id=16,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsBCUK/d98kWpmMU9GtCOu6nr5CDGTtBtm+Xn++wGM4jnm2DyWRjyEh/+NCLMld7/6IKE1/2NukPOJeyCzBwV0Jvso0KIu7787dA73p5k6nI2cKkPoTqObx/zAdZPPwgg==',key_name='tempest-keypair-47503195',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8b1ce9b9f4d4adf8316110aae9e04d7',ramdisk_id='',reservation_id='r-43j0e09d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1196616995',owner_user_name='tempest-TaggedAttachmentsTest-1196616995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ec0b2d09be54070ab00037165788f8a',uuid=3f6a020c-d8b5-4f6b-a3f0-38287111153a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converting VIF {"id": "ffc806fb-1b25-492f-b786-27222f795160", "address": "fa:16:3e:4e:57:32", "network": {"id": "da27b21f-936f-44bf-84a4-2ea0dbd38456", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-381816796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8b1ce9b9f4d4adf8316110aae9e04d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc806fb-1b", "ovs_interfaceid": "ffc806fb-1b25-492f-b786-27222f795160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG os_vif [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffc806fb-1b, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:01:05 user nova-compute[71269]: INFO os_vif [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:57:32,bridge_name='br-int',has_traffic_filtering=True,id=ffc806fb-1b25-492f-b786-27222f795160,network=Network(da27b21f-936f-44bf-84a4-2ea0dbd38456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc806fb-1b')
Apr 13 23:01:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Deleting instance files /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a_del
Apr 13 23:01:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Deletion of /opt/stack/data/nova/instances/3f6a020c-d8b5-4f6b-a3f0-38287111153a_del complete
Apr 13 23:01:05 user nova-compute[71269]: INFO nova.compute.manager [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 23:01:05 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:01:05 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:01:06 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:06 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Took 0.89 seconds to deallocate network for instance.
Apr 13 23:01:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:06 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:06 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:06 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Deleted allocations for instance 3f6a020c-d8b5-4f6b-a3f0-38287111153a
Apr 13 23:01:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a9445897-56e5-4ba5-b29e-5bf4b98761b6 tempest-TaggedAttachmentsTest-1196616995 tempest-TaggedAttachmentsTest-1196616995-project-member] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.341s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Acquiring lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] Lock "3f6a020c-d8b5-4f6b-a3f0-38287111153a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] No waiting events found dispatching network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:07 user nova-compute[71269]: WARNING nova.compute.manager [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received unexpected event network-vif-plugged-ffc806fb-1b25-492f-b786-27222f795160 for instance with vm_state deleted and task_state None.
Apr 13 23:01:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-362789bb-2e57-4639-abfe-b51b8565931e req-4f6d7fac-300f-4527-92d3-b42563e28f99 service nova] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Received event network-vif-deleted-ffc806fb-1b25-492f-b786-27222f795160 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:01:19 user nova-compute[71269]: INFO nova.compute.claims [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Claim successful on node user
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:01:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:01:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Creating image(s)
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "/opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "/opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk 1073741824" returned: 0 in 0.056s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.policy [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6eea00459cc046129decc442a6996ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52ea14393449b3b0ce5a8ed973e435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426865.494706, 3f6a020c-d8b5-4f6b-a3f0-38287111153a => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:20 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] VM Stopped (Lifecycle Event)
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1f42a901-6621-475d-a782-04b305a06428 None None] [instance: 3f6a020c-d8b5-4f6b-a3f0-38287111153a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Cannot resize image /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lazy-loading 'migration_context' on Instance uuid a2979e2c-7ef9-4cbd-8daf-dedd5103f857 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Ensure instance console log exists: /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Successfully created port: 5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:01:21 user nova-compute[71269]: INFO nova.compute.manager [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Rescuing
Apr 13 23:01:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Successfully updated port: 5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquired lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-changed-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Refreshing instance network info cache due to event network-changed-5f5f289c-7a04-41f3-b5e8-73e45d3ac536. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Acquiring lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Updating instance_info_cache with network_info: [{"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Releasing lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Instance network_info: |[{"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Acquired lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Refreshing network info cache for port 5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Start _get_guest_xml network_info=[{"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:01:22 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:22 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-940156379',display_name='tempest-VolumesNegativeTest-instance-940156379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-940156379',id=21,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52ea14393449b3b0ce5a8ed973e435',ramdisk_id='',reservation_id='r-j1xeqh6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-704025732',owner_user_name='tempest-VolumesNegativeTest-704025732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:01:20Z,user_data=None,user_id='6eea00459cc046129decc442a6996ee0',uuid=a2979e2c-7ef9-4cbd-8daf-dedd5103f857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converting VIF {"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lazy-loading 'pci_devices' on Instance uuid a2979e2c-7ef9-4cbd-8daf-dedd5103f857 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:01:22 user nova-compute[71269]:   <uuid>a2979e2c-7ef9-4cbd-8daf-dedd5103f857</uuid>
Apr 13 23:01:22 user nova-compute[71269]:   <name>instance-00000015</name>
Apr 13 23:01:22 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:01:22 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:01:22 user nova-compute[71269]:   <metadata>
Apr 13 23:01:22 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:01:22 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:name>tempest-VolumesNegativeTest-instance-940156379</nova:name>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:01:22</nova:creationTime>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:01:22 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:01:22 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:owner>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:user uuid="6eea00459cc046129decc442a6996ee0">tempest-VolumesNegativeTest-704025732-project-member</nova:user>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:project uuid="ea52ea14393449b3b0ce5a8ed973e435">tempest-VolumesNegativeTest-704025732</nova:project>
Apr 13 23:01:22 user nova-compute[71269]:       </nova:owner>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:01:22 user nova-compute[71269]:       <nova:ports>
Apr 13 23:01:22 user nova-compute[71269]:         <nova:port uuid="5f5f289c-7a04-41f3-b5e8-73e45d3ac536">
Apr 13 23:01:22 user nova-compute[71269]:           <nova:ip type="fixed" address="192.168.233.95" ipVersion="4"/>
Apr 13 23:01:22 user nova-compute[71269]:         </nova:port>
Apr 13 23:01:22 user nova-compute[71269]:       </nova:ports>
Apr 13 23:01:22 user nova-compute[71269]:     </nova:instance>
Apr 13 23:01:22 user nova-compute[71269]:   </metadata>
Apr 13 23:01:22 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:01:22 user nova-compute[71269]:     <system>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="serial">a2979e2c-7ef9-4cbd-8daf-dedd5103f857</entry>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="uuid">a2979e2c-7ef9-4cbd-8daf-dedd5103f857</entry>
Apr 13 23:01:22 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:01:22 user nova-compute[71269]:     </system>
Apr 13 23:01:22 user nova-compute[71269]:   </sysinfo>
Apr 13 23:01:22 user nova-compute[71269]:   <os>
Apr 13 23:01:22 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:01:22 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:01:22 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:01:22 user nova-compute[71269]:   </os>
Apr 13 23:01:22 user nova-compute[71269]:   <features>
Apr 13 23:01:22 user nova-compute[71269]:     <acpi/>
Apr 13 23:01:22 user nova-compute[71269]:     <apic/>
Apr 13 23:01:22 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:01:22 user nova-compute[71269]:   </features>
Apr 13 23:01:22 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:01:22 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:01:22 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:01:22 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:01:22 user nova-compute[71269]:   </clock>
Apr 13 23:01:22 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:01:22 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:01:22 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:01:22 user nova-compute[71269]:   </cpu>
Apr 13 23:01:22 user nova-compute[71269]:   <devices>
Apr 13 23:01:22 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:01:22 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:01:22 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk"/>
Apr 13 23:01:22 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:01:22 user nova-compute[71269]:     </disk>
Apr 13 23:01:22 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:01:22 user nova-compute[71269]:       <mac address="fa:16:3e:fe:f7:11"/>
Apr 13 23:01:22 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:22 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:01:22 user nova-compute[71269]:       <target dev="tap5f5f289c-7a"/>
Apr 13 23:01:22 user nova-compute[71269]:     </interface>
Apr 13 23:01:22 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:01:22 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/console.log" append="off"/>
Apr 13 23:01:22 user nova-compute[71269]:     </serial>
Apr 13 23:01:22 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:01:22 user nova-compute[71269]:     <video>
Apr 13 23:01:22 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:22 user nova-compute[71269]:     </video>
Apr 13 23:01:22 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:01:22 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:01:22 user nova-compute[71269]:     </rng>
Apr 13 23:01:22 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:01:22 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:01:22 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:01:22 user nova-compute[71269]:     </memballoon>
Apr 13 23:01:22 user nova-compute[71269]:   </devices>
Apr 13 23:01:22 user nova-compute[71269]: </domain>
Apr 13 23:01:22 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-940156379',display_name='tempest-VolumesNegativeTest-instance-940156379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-940156379',id=21,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52ea14393449b3b0ce5a8ed973e435',ramdisk_id='',reservation_id='r-j1xeqh6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-704025732',owner_user_name='tempest-VolumesNegativeTest-704025732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:01:20Z,user_data=None,user_id='6eea00459cc046129decc442a6996ee0',uuid=a2979e2c-7ef9-4cbd-8daf-dedd5103f857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converting VIF {"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG os_vif [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5f289c-7a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f5f289c-7a, col_values=(('external_ids', {'iface-id': '5f5f289c-7a04-41f3-b5e8-73e45d3ac536', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:f7:11', 'vm-uuid': 'a2979e2c-7ef9-4cbd-8daf-dedd5103f857'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: INFO os_vif [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a')
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] No VIF found with MAC fa:16:3e:fe:f7:11, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:22 user nova-compute[71269]: WARNING nova.compute.manager [req-7f6fc8a0-56ce-4e8f-bcdc-56eab54dbeae req-e8a74705-cea6-4a0e-bccf-af64992d965b service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state rescuing.
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Updated VIF entry in instance network info cache for port 5f5f289c-7a04-41f3-b5e8-73e45d3ac536. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Updating instance_info_cache with network_info: [{"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3f4f086-bffe-46a4-ba5c-98e971ae08e5 req-2c0ecee9-3c0e-4d77-9942-963e3ce9c7b3 service nova] Releasing lock "refresh_cache-a2979e2c-7ef9-4cbd-8daf-dedd5103f857" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance destroyed successfully.
Apr 13 23:01:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Attempting a stable device rescue
Apr 13 23:01:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 23:01:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Creating image(s)
Apr 13 23:01:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'trusted_certs' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] No waiting events found dispatching network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:24 user nova-compute[71269]: WARNING nova.compute.manager [req-6a5b7133-6226-4fa5-ab06-0681ab3c4b68 req-e501d630-9448-463a-9b8f-bcf940ffbd95 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received unexpected event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance with vm_state building and task_state spawning.
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.virt.images [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 1883aa58-f5b6-4162-a531-94bd4fdc1547 was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.part /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:24 user nova-compute[71269]: WARNING nova.compute.manager [req-48b84e57-d25c-439f-a72e-e7d063df44fa req-4fa4ee73-2e1a-4d86-9afb-bb72a18582e9 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state rescuing.
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.part /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.converted" returned: 0 in 0.469s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.626s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4 --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4,backing_fmt=raw /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4,backing_fmt=raw /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue" returned: 0 in 0.048s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "9d99a82db9ff80d9f5cded0c9c940406de8f15f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'migration_context' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start _get_guest_xml network_info=[{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:34:11:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1883aa58-f5b6-4162-a531-94bd4fdc1547', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '561562a4-4a3b-4bb8-9bbb-f5f60ba863d6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '31ec73b0-9b2a-4fc1-be85-4179075afdb8', 'attached_at': '', 'detached_at': '', 'volume_id': '8872b098-b9f8-4636-a183-7cc7ee479ac2', 'serial': '8872b098-b9f8-4636-a183-7cc7ee479ac2'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'numa_topology' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:01:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:25 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0de874-875b-45bb-a982-ee6bef9fa6e9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QPCUlxyb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 23:01:25 user nova-compute[71269]: node.name = iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:01:25 user nova-compute[71269]: node.tpgt = -1
Apr 13 23:01:25 user nova-compute[71269]: node.startup = automatic
Apr 13 23:01:25 user nova-compute[71269]: node.leading_login = No
Apr 13 23:01:25 user nova-compute[71269]: iface.iscsi_ifacename = default
Apr 13 23:01:25 user nova-compute[71269]: iface.net_ifacename = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.ipaddress = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.prefix_len = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.hwaddress = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.transport_name = tcp
Apr 13 23:01:25 user nova-compute[71269]: iface.initiatorname = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.vlan_id = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.vlan_priority = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.vlan_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.iface_num = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.mtu = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.port = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.bootproto = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.subnet_mask = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.gateway = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_alt_client_id = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_dns = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_learn_iqn = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_vendor_id_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_vendor_id = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.dhcp_slp_da = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.fragmentation = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.gratuitous_arp = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.incoming_forwarding = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.tos_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.tos = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.ttl = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.delayed_ack = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.tcp_nagle = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.tcp_wsf_state = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.tcp_wsf = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.tcp_timer_scale = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.tcp_timestamp = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.redirect = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.def_task_mgmt_timeout = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.header_digest = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.data_digest = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.immediate_data = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.initial_r2t = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.data_seq_inorder = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.data_pdu_inorder = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.erl = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.max_receive_data_len = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.first_burst_len = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.max_outstanding_r2t = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.max_burst_len = 0
Apr 13 23:01:25 user nova-compute[71269]: iface.chap_auth = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.bidi_chap = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.strict_login_compliance = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.discovery_auth = <empty>
Apr 13 23:01:25 user nova-compute[71269]: iface.discovery_logout = <empty>
Apr 13 23:01:25 user nova-compute[71269]: node.discovery_address = <empty>
Apr 13 23:01:25 user nova-compute[71269]: node.discovery_port = 0
Apr 13 23:01:25 user nova-compute[71269]: node.discovery_type = static
Apr 13 23:01:25 user nova-compute[71269]: node.session.initial_cmdsn = 0
Apr 13 23:01:25 user nova-compute[71269]: node.session.initial_login_retry_max = 8
Apr 13 23:01:25 user nova-compute[71269]: node.session.xmit_thread_priority = -20
Apr 13 23:01:25 user nova-compute[71269]: node.session.cmds_max = 128
Apr 13 23:01:25 user nova-compute[71269]: node.session.queue_depth = 32
Apr 13 23:01:25 user nova-compute[71269]: node.session.nr_sessions = 1
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.authmethod = CHAP
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.username = QPCUlxyb
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.password = ***
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.username_in = <empty>
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.password_in = <empty>
Apr 13 23:01:25 user nova-compute[71269]: node.session.auth.chap_algs = MD5
Apr 13 23:01:25 user nova-compute[71269]: node.session.timeo.replacement_timeout = 120
Apr 13 23:01:25 user nova-compute[71269]: node.session.err_timeo.abort_timeout = 15
Apr 13 23:01:25 user nova-compute[71269]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 23:01:25 user nova-compute[71269]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 23:01:25 user nova-compute[71269]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.FastAbort = Yes
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.InitialR2T = No
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.ImmediateData = Yes
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.MaxConnections = 1
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 23:01:25 user nova-compute[71269]: node.session.iscsi.ERL = 0
Apr 13 23:01:25 user nova-compute[71269]: node.session.scan = manual
Apr 13 23:01:25 user nova-compute[71269]: node.session.reopen_max = 0
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].address = 172.16.0.220
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].port = 3260
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].startup = manual
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].tcp.window_size = 524288
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].tcp.type_of_service = 0
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].timeo.logout_timeout = 15
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].timeo.login_timeout = 15
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].timeo.auth_timeout = 45
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.DataDigest = None
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.IFMarker = No
Apr 13 23:01:25 user nova-compute[71269]: node.conn[0].iscsi.OFMarker = No
Apr 13 23:01:25 user nova-compute[71269]: # END RECORD
Apr 13 23:01:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2353307-faf1-432c-8be0-feb6a485b602]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c99cbe9-708d-42a9-bf40-0897a361622f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPCUlxyb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPCUlxyb" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbb6812-ec65-49e1-86f6-85c7ffe262a0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPCUlxyb'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1719e-5470-4164-ab47-647d2bd1ba0d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d52459-82cf-4c64-978d-9a6496ce09da]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HCTL ('35', '0', '0', 0) found on session 18 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487d232-1db3-4ed8-ba06-ff770c096a61]: (4, ('0 0 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Searching for a device in session 18 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '26661646632313139', 'path': '/dev/sdd'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661646632313139', 'path': '/dev/sdd'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343743038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343743038',id=18,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-7qxuk3m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T22:59:47Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=31ec73b0-9b2a-4fc1-be85-4179075afdb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:34:11:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:34:11:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:01:25 user nova-compute[71269]:   <uuid>31ec73b0-9b2a-4fc1-be85-4179075afdb8</uuid>
Apr 13 23:01:25 user nova-compute[71269]:   <name>instance-00000012</name>
Apr 13 23:01:25 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:01:25 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:01:25 user nova-compute[71269]:   <metadata>
Apr 13 23:01:25 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:01:25 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1343743038</nova:name>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:01:25</nova:creationTime>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:01:25 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:01:25 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:owner>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 23:01:25 user nova-compute[71269]:       </nova:owner>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:01:25 user nova-compute[71269]:       <nova:ports>
Apr 13 23:01:25 user nova-compute[71269]:         <nova:port uuid="0f1a7f33-f5b1-4acf-baac-7e66a5f97d37">
Apr 13 23:01:25 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 23:01:25 user nova-compute[71269]:         </nova:port>
Apr 13 23:01:25 user nova-compute[71269]:       </nova:ports>
Apr 13 23:01:25 user nova-compute[71269]:     </nova:instance>
Apr 13 23:01:25 user nova-compute[71269]:   </metadata>
Apr 13 23:01:25 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:01:25 user nova-compute[71269]:     <system>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="serial">31ec73b0-9b2a-4fc1-be85-4179075afdb8</entry>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="uuid">31ec73b0-9b2a-4fc1-be85-4179075afdb8</entry>
Apr 13 23:01:25 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:01:25 user nova-compute[71269]:     </system>
Apr 13 23:01:25 user nova-compute[71269]:   </sysinfo>
Apr 13 23:01:25 user nova-compute[71269]:   <os>
Apr 13 23:01:25 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:01:25 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:01:25 user nova-compute[71269]:   </os>
Apr 13 23:01:25 user nova-compute[71269]:   <features>
Apr 13 23:01:25 user nova-compute[71269]:     <acpi/>
Apr 13 23:01:25 user nova-compute[71269]:     <apic/>
Apr 13 23:01:25 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:01:25 user nova-compute[71269]:   </features>
Apr 13 23:01:25 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:01:25 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:01:25 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:01:25 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:01:25 user nova-compute[71269]:   </clock>
Apr 13 23:01:25 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:01:25 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:01:25 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:01:25 user nova-compute[71269]:   </cpu>
Apr 13 23:01:25 user nova-compute[71269]:   <devices>
Apr 13 23:01:25 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:01:25 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:01:25 user nova-compute[71269]:       <source dev="/dev/sdd"/>
Apr 13 23:01:25 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:01:25 user nova-compute[71269]:       <serial>8872b098-b9f8-4636-a183-7cc7ee479ac2</serial>
Apr 13 23:01:25 user nova-compute[71269]:     </disk>
Apr 13 23:01:25 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:01:25 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:01:25 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue"/>
Apr 13 23:01:25 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:01:25 user nova-compute[71269]:       <boot order="1"/>
Apr 13 23:01:25 user nova-compute[71269]:     </disk>
Apr 13 23:01:25 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:01:25 user nova-compute[71269]:       <mac address="fa:16:3e:34:11:5b"/>
Apr 13 23:01:25 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:25 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:01:25 user nova-compute[71269]:       <target dev="tap0f1a7f33-f5"/>
Apr 13 23:01:25 user nova-compute[71269]:     </interface>
Apr 13 23:01:25 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:01:25 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/console.log" append="off"/>
Apr 13 23:01:25 user nova-compute[71269]:     </serial>
Apr 13 23:01:25 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:01:25 user nova-compute[71269]:     <video>
Apr 13 23:01:25 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:25 user nova-compute[71269]:     </video>
Apr 13 23:01:25 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:01:25 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:01:25 user nova-compute[71269]:     </rng>
Apr 13 23:01:25 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:01:25 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:01:25 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:01:25 user nova-compute[71269]:     </memballoon>
Apr 13 23:01:25 user nova-compute[71269]:   </devices>
Apr 13 23:01:25 user nova-compute[71269]: </domain>
Apr 13 23:01:25 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:01:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance destroyed successfully.
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:34:11:5b, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-changed-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Refreshing instance network info cache due to event network-changed-79c62453-7ae2-480d-aa21-a5f26dfb0763. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Acquiring lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Acquired lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.network.neutron [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Refreshing network info cache for port 79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] No waiting events found dispatching network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:26 user nova-compute[71269]: WARNING nova.compute.manager [req-3b49f909-911b-4082-8e0c-2a96644f2ad0 req-053c8c63-c3d4-479d-abfd-916b710305c1 service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received unexpected event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance with vm_state building and task_state spawning.
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426886.6777992, a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] VM Resumed (Lifecycle Event)
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Instance spawned successfully.
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.network.neutron [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updated VIF entry in instance network info cache for port 79c62453-7ae2-480d-aa21-a5f26dfb0763. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.network.neutron [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updating instance_info_cache with network_info: [{"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426886.6808689, a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] VM Started (Lifecycle Event)
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-76224d49-53c8-423e-9ead-c2cf16078371 req-0b904acd-7400-476b-9d85-677f960b90b5 service nova] Releasing lock "refresh_cache-4435b0c4-7292-4348-bcd9-a712a2df3e91" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Took 6.91 seconds to spawn the instance on the hypervisor.
Apr 13 23:01:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:26 user nova-compute[71269]: INFO nova.compute.manager [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Took 7.59 seconds to build instance.
Apr 13 23:01:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8d5505ba-af5e-4219-8102-2c67eb63c3d0 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.718s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:27 user nova-compute[71269]: WARNING nova.compute.manager [req-eb078b68-2d9f-4065-a13c-14ec5fcb9147 req-209e2958-d594-4fa5-8727-530dd3e33ea7 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state rescuing.
Apr 13 23:01:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:29 user nova-compute[71269]: INFO nova.compute.manager [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Attaching volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 to /dev/vdb
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:29 user nova-compute[71269]: WARNING nova.compute.manager [req-e9668b01-4e6f-4fe7-bb3c-c51ec1a4f224 req-fae46811-b83f-43fe-8ba9-8ad19ed2d1d8 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state rescuing.
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.utils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353b2e2-ece2-4e1a-9a3a-5cfbeed1782a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40d864c-fc1a-4882-a5da-0bd100cebd0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5477b38-be9e-4da7-b14c-d2c2b497d832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc6b22-a423-499f-8cda-3866de14674a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:01:29 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:01:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ccced-f9ec-4d72-8655-05ec8d960f38]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG os_brick.utils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updating existing volume attachment record: 3ff14fc9-1153-4519-9cd7-1f8a7d7b49ac {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 31ec73b0-9b2a-4fc1-be85-4179075afdb8 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426889.7996707, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Resumed (Lifecycle Event)
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-17bf702c-bace-4bdb-86b4-8dd46ed14be4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426889.8029473, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Started (Lifecycle Event)
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:30 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:01:30 user nova-compute[71269]: INFO nova.compute.claims [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Claim successful on node user
Apr 13 23:01:30 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:01:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:01:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Creating image(s)
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.policy [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28cb6d8d6e3d4ef7aa53bb17faf495c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6a1fccc07f4f5a8f8f8617ae03955d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.175s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk 1073741824" returned: 0 in 0.095s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.199s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:01:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Cannot resize image /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Ensure instance console log exists: /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:32 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Successfully created port: c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:01:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Successfully updated port: c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing instance network info cache due to event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance network_info: |[{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start _get_guest_xml network_info=[{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:01:34 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:34 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127216369',display_name='tempest-ServerRescueNegativeTestJSON-server-1127216369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127216369',id=22,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vlH4K190ZLaXGZADGTKyJqq1HrjF8mcn+GStKL4ZJ0L5vSiY+ekY/NcmigKtITRdMzH4ykVfwffOwzTyyJICm8WdBeAnwGlDcy6UYkDS+DFs4nMGVpTbq7hSi2P8hhA==',key_name='tempest-keypair-1129500402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-l38vxe9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=deb24b5e-f858-4068-88c5-3c7708c7e195,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:01:34 user nova-compute[71269]:   <uuid>deb24b5e-f858-4068-88c5-3c7708c7e195</uuid>
Apr 13 23:01:34 user nova-compute[71269]:   <name>instance-00000016</name>
Apr 13 23:01:34 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:01:34 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:01:34 user nova-compute[71269]:   <metadata>
Apr 13 23:01:34 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:01:34 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1127216369</nova:name>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:01:34</nova:creationTime>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:01:34 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:01:34 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:owner>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 23:01:34 user nova-compute[71269]:       </nova:owner>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:01:34 user nova-compute[71269]:       <nova:ports>
Apr 13 23:01:34 user nova-compute[71269]:         <nova:port uuid="c7f804a4-0e8d-4d99-a547-5c9252cb872c">
Apr 13 23:01:34 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 23:01:34 user nova-compute[71269]:         </nova:port>
Apr 13 23:01:34 user nova-compute[71269]:       </nova:ports>
Apr 13 23:01:34 user nova-compute[71269]:     </nova:instance>
Apr 13 23:01:34 user nova-compute[71269]:   </metadata>
Apr 13 23:01:34 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:01:34 user nova-compute[71269]:     <system>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="serial">deb24b5e-f858-4068-88c5-3c7708c7e195</entry>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="uuid">deb24b5e-f858-4068-88c5-3c7708c7e195</entry>
Apr 13 23:01:34 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:01:34 user nova-compute[71269]:     </system>
Apr 13 23:01:34 user nova-compute[71269]:   </sysinfo>
Apr 13 23:01:34 user nova-compute[71269]:   <os>
Apr 13 23:01:34 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:01:34 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:01:34 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:01:34 user nova-compute[71269]:   </os>
Apr 13 23:01:34 user nova-compute[71269]:   <features>
Apr 13 23:01:34 user nova-compute[71269]:     <acpi/>
Apr 13 23:01:34 user nova-compute[71269]:     <apic/>
Apr 13 23:01:34 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:01:34 user nova-compute[71269]:   </features>
Apr 13 23:01:34 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:01:34 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:01:34 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:01:34 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:01:34 user nova-compute[71269]:   </clock>
Apr 13 23:01:34 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:01:34 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:01:34 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:01:34 user nova-compute[71269]:   </cpu>
Apr 13 23:01:34 user nova-compute[71269]:   <devices>
Apr 13 23:01:34 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:01:34 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:01:34 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk"/>
Apr 13 23:01:34 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:01:34 user nova-compute[71269]:     </disk>
Apr 13 23:01:34 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:01:34 user nova-compute[71269]:       <mac address="fa:16:3e:d0:65:0c"/>
Apr 13 23:01:34 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:34 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:01:34 user nova-compute[71269]:       <target dev="tapc7f804a4-0e"/>
Apr 13 23:01:34 user nova-compute[71269]:     </interface>
Apr 13 23:01:34 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:01:34 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/console.log" append="off"/>
Apr 13 23:01:34 user nova-compute[71269]:     </serial>
Apr 13 23:01:34 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:01:34 user nova-compute[71269]:     <video>
Apr 13 23:01:34 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:01:34 user nova-compute[71269]:     </video>
Apr 13 23:01:34 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:01:34 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:01:34 user nova-compute[71269]:     </rng>
Apr 13 23:01:34 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:01:34 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:01:34 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:01:34 user nova-compute[71269]:     </memballoon>
Apr 13 23:01:34 user nova-compute[71269]:   </devices>
Apr 13 23:01:34 user nova-compute[71269]: </domain>
Apr 13 23:01:34 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127216369',display_name='tempest-ServerRescueNegativeTestJSON-server-1127216369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127216369',id=22,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vlH4K190ZLaXGZADGTKyJqq1HrjF8mcn+GStKL4ZJ0L5vSiY+ekY/NcmigKtITRdMzH4ykVfwffOwzTyyJICm8WdBeAnwGlDcy6UYkDS+DFs4nMGVpTbq7hSi2P8hhA==',key_name='tempest-keypair-1129500402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-l38vxe9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=deb24b5e-f858-4068-88c5-3c7708c7e195,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG os_vif [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f804a4-0e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7f804a4-0e, col_values=(('external_ids', {'iface-id': 'c7f804a4-0e8d-4d99-a547-5c9252cb872c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:65:0c', 'vm-uuid': 'deb24b5e-f858-4068-88c5-3c7708c7e195'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:34 user nova-compute[71269]: INFO os_vif [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e')
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:d0:65:0c, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKfXjoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:01:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:35 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffefa33-5879-41c1-86e0-9a83a76711cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:01:35 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe201113-0e14-4816-b54a-eaffdfe770da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263] added
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84d631-f532-46b8-b59f-237c4c41aa26]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updated VIF entry in instance network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7ce8a2-e827-4766-9b0e-beac40626ea1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKfXjoIi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ffff0c3-f0ba-4c64-8e28-7026812b5b65 req-2fa0758a-71c4-47be-a74d-2894e2bbb1f5 service nova] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKfXjoIi" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acbce6c-97b6-4c6f-baa9-e07a1dd2bb77]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKfXjoIi'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f21a74-452a-4b7a-a168-f046700ed44f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6830d50-729c-4eac-aabc-1e86c8819b70]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c3ac45-66a1-4d9e-88ec-54c8fb22cfd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260]
Apr 13 23:01:35 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260] successful.
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d4a08-ffbf-42bf-bd50-bef5c6312c96]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d905ae5-e05f-47a1-83bc-b939b7680216]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)
Apr 13 23:01:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[09454867-c16f-458e-9630-51b836eea029]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKfXjoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26431623638373965', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431623638373965', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:36 user nova-compute[71269]: WARNING nova.compute.manager [req-89276ca4-534c-42b9-ab51-49ff7f540b38 req-e4dfebb3-bc46-459d-a946-86d5b6bb0ef2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state building and task_state spawning.
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:01:36 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:01:36 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:01:36 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:01:36 user nova-compute[71269]:   <serial>c2fc1b14-26b8-4e46-bcb1-9500056d5263</serial>
Apr 13 23:01:36 user nova-compute[71269]: </disk>
Apr 13 23:01:36 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:01:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:4c:71:82, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:01:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1519d773-334b-44e9-9614-a327e37c285c tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.786s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:38 user nova-compute[71269]: WARNING nova.compute.manager [req-f5c60aa9-e3d3-4e77-9b25-9f97b858c27d req-2a53c3ac-d6fb-4fe6-8675-7d64472cb8b7 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state building and task_state spawning.
Apr 13 23:01:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Detaching volume c2fc1b14-26b8-4e46-bcb1-9500056d5263
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.virt.block_device [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Attempting to driver detach volume c2fc1b14-26b8-4e46-bcb1-9500056d5263 from mountpoint /dev/vdb
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Attempting to detach device vdb from instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:01:38 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:01:38 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:01:38 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:01:38 user nova-compute[71269]:   <serial>c2fc1b14-26b8-4e46-bcb1-9500056d5263</serial>
Apr 13 23:01:38 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:01:38 user nova-compute[71269]: </disk>
Apr 13 23:01:38 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 from the persistent domain config.
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:01:38 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:01:38 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:01:38 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:01:38 user nova-compute[71269]:   <serial>c2fc1b14-26b8-4e46-bcb1-9500056d5263</serial>
Apr 13 23:01:38 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:01:38 user nova-compute[71269]: </disk>
Apr 13 23:01:38 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426898.8273582, deb24b5e-f858-4068-88c5-3c7708c7e195 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Resumed (Lifecycle Event)
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance spawned successfully.
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426898.8286333, deb24b5e-f858-4068-88c5-3c7708c7e195 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Started (Lifecycle Event)
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Took 7.68 seconds to spawn the instance on the hypervisor.
Apr 13 23:01:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:01:39 user nova-compute[71269]: INFO nova.compute.manager [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Took 8.59 seconds to build instance.
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7b2-82bd-4421-87c6-a7b1c6bded0c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.694s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681426899.1756485, 4435b0c4-7292-4348-bcd9-a712a2df3e91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:01:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 from the live domain config.
Apr 13 23:01:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKfXjoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:01:39 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34ff3c-3727-4ac2-86f2-ec11b100c3b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:01:39 user nova-compute[71269]: No targets found.
Apr 13 23:01:39 user nova-compute[71269]: iSNS:
Apr 13 23:01:39 user nova-compute[71269]: No targets found.
Apr 13 23:01:39 user nova-compute[71269]: STATIC:
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263
Apr 13 23:01:39 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:39 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:39 user nova-compute[71269]: FIRMWARE:
Apr 13 23:01:39 user nova-compute[71269]: No targets found.
Apr 13 23:01:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:01:39 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:01:39 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc6b984-2b3c-486d-80bf-a39d5a53d503]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c69f90-1b94-4746-9e3b-224a0b1aca77]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 (non-flash)
Apr 13 23:01:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb4fd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5143e90f-23f4-4a96-badf-4d718b1575d2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e2b91-abd2-43ac-90a6-7b9ac17baa62]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[081073c5-7f21-446d-96ac-b96ba70436ee]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[34043dba-5056-4e49-a94a-b30cf98457ff]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71be5c-7eda-4f84-ac91-c967f5fd27b6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdbd169-1b7e-4a9a-a55d-c9a8e34e0f55]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260]
Apr 13 23:01:39 user nova-compute[71269]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263, portal: 172.16.0.220,3260] successful.
Apr 13 23:01:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fc1b14-26b8-4e46-bcb1-9500056d5263 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6276b-25f1-4a7c-880d-c63419478c8a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== disconnect_volume: return (388ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:01:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:40 user nova-compute[71269]: DEBUG nova.objects.instance [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-371a4141-40f1-4ffa-b976-56940ccac389 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:41 user nova-compute[71269]: INFO nova.compute.manager [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Terminating instance
Apr 13 23:01:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-unplugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] No waiting events found dispatching network-vif-unplugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-897c787d-0431-42b0-801a-4a5093f748ee req-f7676ffb-8612-460f-abca-e791ca971219 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-unplugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:41 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Instance destroyed successfully.
Apr 13 23:01:41 user nova-compute[71269]: DEBUG nova.objects.instance [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:57:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1413427865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1413427865',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-ftvmgczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:57:14Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=05c9ae9c-47df-41c7-8805-f6fe22bf09d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "address": "fa:16:3e:92:14:9a", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b60d2d-f4", "ovs_interfaceid": "b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_vif [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b60d2d-f4, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:01:42 user nova-compute[71269]: INFO os_vif [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b60d2d-f4')
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQPCjqrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:01:42 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb83ca84-a30a-4325-a2c4-203e0ead9a60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:01:42 user nova-compute[71269]: No targets found.
Apr 13 23:01:42 user nova-compute[71269]: iSNS:
Apr 13 23:01:42 user nova-compute[71269]: No targets found.
Apr 13 23:01:42 user nova-compute[71269]: STATIC:
Apr 13 23:01:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:01:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:01:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1
Apr 13 23:01:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:01:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:42 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71
Apr 13 23:01:42 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:01:42 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:01:42 user nova-compute[71269]: FIRMWARE:
Apr 13 23:01:42 user nova-compute[71269]: No targets found.
Apr 13 23:01:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:01:42 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:01:42 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ee046-23d2-48a1-8dbd-2578215e476b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df43cea-334f-4046-99c5-8cb850ba8cb5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:01:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc396200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f719c9-73d4-4679-a885-97882cdb0fbc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe32a8-d705-432a-9afc-e93199e29821]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e10f6-202a-4670-8078-4919535b697c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848caa9-99d8-4cbe-849d-32fdc3f3238f]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724354d-1bd2-4f61-97e9-52b505ddde6d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7690a00-e372-40e6-acfa-083923625c30]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260]
Apr 13 23:01:42 user nova-compute[71269]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1, portal: 172.16.0.220,3260] successful.
Apr 13 23:01:42 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6e2122-7182-409a-ac67-4361de1d68a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a7459-a4e9-447a-a125-c3ab2c106efe]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (375ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:01:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Deleting instance files /opt/stack/data/nova/instances/05c9ae9c-47df-41c7-8805-f6fe22bf09d6_del
Apr 13 23:01:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Deletion of /opt/stack/data/nova/instances/05c9ae9c-47df-41c7-8805-f6fe22bf09d6_del complete
Apr 13 23:01:42 user nova-compute[71269]: INFO nova.compute.manager [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 13 23:01:42 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:01:42 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:43 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Took 0.50 seconds to deallocate network for instance.
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-deleted-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:43 user nova-compute[71269]: INFO nova.compute.manager [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Neutron deleted interface b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c; detaching it from the instance and deleting it from the info cache
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-05f767e0-b3af-4fc5-9c75-b40db2e7baf8 req-ae464137-edca-4fe1-b8fa-b55fe3a79e15 service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Detach interface failed, port_id=b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c, reason: Instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Acquiring lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] No waiting events found dispatching network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:43 user nova-compute[71269]: WARNING nova.compute.manager [req-89c55586-07c3-4597-8799-b14a80e09311 req-6ebeb5bf-58a9-43c5-9c51-0d5dc463eedd service nova] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Received unexpected event network-vif-plugged-b7b60d2d-f4b0-4ccd-8aea-6dae6c9ed97c for instance with vm_state active and task_state deleting.
Apr 13 23:01:43 user nova-compute[71269]: INFO nova.compute.manager [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 23:01:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Deleting volume: ca6e2122-7182-409a-ac67-4361de1d68a1 {{(pid=71269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:44 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:44 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:44 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance 05c9ae9c-47df-41c7-8805-f6fe22bf09d6
Apr 13 23:01:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-814d597f-21b3-4838-96fe-c55a09eb6572 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "05c9ae9c-47df-41c7-8805-f6fe22bf09d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.251s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:48 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:51 user nova-compute[71269]: INFO nova.compute.manager [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Terminating instance
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-8d65b906-b407-44cf-bae3-9f73a7ede109 req-464bad47-5998-4332-8bc0-638b1a2b72d1 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-unplugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Instance destroyed successfully.
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'resources' on Instance uuid b190941d-9f62-41ef-881d-e02d246e9138 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1582878166',display_name='tempest-TestMinimumBasicScenario-server-1582878166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1582878166',id=14,image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtgXoWxAxDyqtpEaZ6qyW9uFinkc74wYRhX75QmNd3vBCY/1sKwsXtNiybFOUXArf5K7l/6NgGA8NhciQ3r5iyBdwkb4azHGVTrBBkzOPQ19E6AZBW7SmSTh0Xg7qdsSg==',key_name='tempest-TestMinimumBasicScenario-1486131087',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-nske7i8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4ff522-0822-422c-8f3d-ad6afaa48909',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:14Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=b190941d-9f62-41ef-881d-e02d246e9138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "address": "fa:16:3e:f9:25:e8", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37865aaf-d7", "ovs_interfaceid": "37865aaf-d7fb-4f6b-b764-2b75e9d3e924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG os_vif [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37865aaf-d7, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:01:51 user nova-compute[71269]: INFO os_vif [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:e8,bridge_name='br-int',has_traffic_filtering=True,id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37865aaf-d7')
Apr 13 23:01:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Deleting instance files /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138_del
Apr 13 23:01:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Deletion of /opt/stack/data/nova/instances/b190941d-9f62-41ef-881d-e02d246e9138_del complete
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:01:52 user nova-compute[71269]: INFO nova.compute.manager [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 13 23:01:52 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:01:52 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:52 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=26.322933197021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:52 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Took 0.62 seconds to deallocate network for instance.
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-deleted-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:52 user nova-compute[71269]: INFO nova.compute.manager [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Neutron deleted interface 37865aaf-d7fb-4f6b-b764-2b75e9d3e924; detaching it from the instance and deleting it from the info cache
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.network.neutron [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f1160cb-ba27-4c1d-a498-1da1896c51fe req-197bb00d-de17-4332-9d4a-619b2427d22f service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Detach interface failed, port_id=37865aaf-d7fb-4f6b-b764-2b75e9d3e924, reason: Instance b190941d-9f62-41ef-881d-e02d246e9138 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 92e1fa88-8896-4198-af4d-56d44baf3b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b190941d-9f62-41ef-881d-e02d246e9138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 4435b0c4-7292-4348-bcd9-a712a2df3e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:01:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.361s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Acquiring lock "b190941d-9f62-41ef-881d-e02d246e9138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] Lock "b190941d-9f62-41ef-881d-e02d246e9138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] No waiting events found dispatching network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:01:53 user nova-compute[71269]: WARNING nova.compute.manager [req-d04ebc00-8977-42e9-b933-f98562f01e38 req-4c9d4410-331e-417f-8188-05ce72181666 service nova] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Received unexpected event network-vif-plugged-37865aaf-d7fb-4f6b-b764-2b75e9d3e924 for instance with vm_state deleted and task_state None.
Apr 13 23:01:53 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Deleted allocations for instance b190941d-9f62-41ef-881d-e02d246e9138
Apr 13 23:01:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a80bb38e-fb5a-4933-8f27-d69456c38fd3 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "b190941d-9f62-41ef-881d-e02d246e9138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:01:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:01:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:01:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:01:56 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426901.9849563, 05c9ae9c-47df-41c7-8805-f6fe22bf09d6 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:01:56 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] VM Stopped (Lifecycle Event)
Apr 13 23:01:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-91c9ea3c-9c0a-4015-a2dd-7de3101a4a92 None None] [instance: 05c9ae9c-47df-41c7-8805-f6fe22bf09d6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:01:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:06 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426911.852665, b190941d-9f62-41ef-881d-e02d246e9138 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:06 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b190941d-9f62-41ef-881d-e02d246e9138] VM Stopped (Lifecycle Event)
Apr 13 23:02:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b601c315-026c-45ef-9de6-ed7f7b6fd4ce None None] [instance: b190941d-9f62-41ef-881d-e02d246e9138] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:02:14 user nova-compute[71269]: INFO nova.compute.claims [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Claim successful on node user
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:02:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:02:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.policy [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:02:15 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Creating image(s)
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "/opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "/opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk 1073741824" returned: 0 in 0.102s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Successfully created port: 29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Cannot resize image /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.objects.instance [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'migration_context' on Instance uuid dc473fb8-e574-4e49-b860-3ae0066cc9b8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Ensure instance console log exists: /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Successfully updated port: 29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquired lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-changed-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Refreshing instance network info cache due to event network-changed-29e91af8-5b8e-4872-9ee0-9cc4b79fb647. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Acquiring lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.neutron [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Updating instance_info_cache with network_info: [{"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Releasing lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Instance network_info: |[{"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Acquired lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Refreshing network info cache for port 29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Start _get_guest_xml network_info=[{"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:02:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-18447064',display_name='tempest-ServersNegativeTestJSON-server-18447064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-18447064',id=23,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-hffexq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:15Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=dc473fb8-e574-4e49-b860-3ae0066cc9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'pci_devices' on Instance uuid dc473fb8-e574-4e49-b860-3ae0066cc9b8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:02:16 user nova-compute[71269]:   <uuid>dc473fb8-e574-4e49-b860-3ae0066cc9b8</uuid>
Apr 13 23:02:16 user nova-compute[71269]:   <name>instance-00000017</name>
Apr 13 23:02:16 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:02:16 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:02:16 user nova-compute[71269]:   <metadata>
Apr 13 23:02:16 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:02:16 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:name>tempest-ServersNegativeTestJSON-server-18447064</nova:name>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:02:16</nova:creationTime>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:02:16 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:02:16 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:owner>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:user uuid="71593deacbd74fea9fc2faf5a9b08877">tempest-ServersNegativeTestJSON-1433854176-project-member</nova:user>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:project uuid="d8a3c684b0414336b2ca770eb1f3ab17">tempest-ServersNegativeTestJSON-1433854176</nova:project>
Apr 13 23:02:16 user nova-compute[71269]:       </nova:owner>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:02:16 user nova-compute[71269]:       <nova:ports>
Apr 13 23:02:16 user nova-compute[71269]:         <nova:port uuid="29e91af8-5b8e-4872-9ee0-9cc4b79fb647">
Apr 13 23:02:16 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:02:16 user nova-compute[71269]:         </nova:port>
Apr 13 23:02:16 user nova-compute[71269]:       </nova:ports>
Apr 13 23:02:16 user nova-compute[71269]:     </nova:instance>
Apr 13 23:02:16 user nova-compute[71269]:   </metadata>
Apr 13 23:02:16 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:02:16 user nova-compute[71269]:     <system>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="serial">dc473fb8-e574-4e49-b860-3ae0066cc9b8</entry>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="uuid">dc473fb8-e574-4e49-b860-3ae0066cc9b8</entry>
Apr 13 23:02:16 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:02:16 user nova-compute[71269]:     </system>
Apr 13 23:02:16 user nova-compute[71269]:   </sysinfo>
Apr 13 23:02:16 user nova-compute[71269]:   <os>
Apr 13 23:02:16 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:02:16 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:02:16 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:02:16 user nova-compute[71269]:   </os>
Apr 13 23:02:16 user nova-compute[71269]:   <features>
Apr 13 23:02:16 user nova-compute[71269]:     <acpi/>
Apr 13 23:02:16 user nova-compute[71269]:     <apic/>
Apr 13 23:02:16 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:02:16 user nova-compute[71269]:   </features>
Apr 13 23:02:16 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:02:16 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:02:16 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:02:16 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:02:16 user nova-compute[71269]:   </clock>
Apr 13 23:02:16 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:02:16 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:02:16 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:02:16 user nova-compute[71269]:   </cpu>
Apr 13 23:02:16 user nova-compute[71269]:   <devices>
Apr 13 23:02:16 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:02:16 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:02:16 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk"/>
Apr 13 23:02:16 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:02:16 user nova-compute[71269]:     </disk>
Apr 13 23:02:16 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:02:16 user nova-compute[71269]:       <mac address="fa:16:3e:d8:8e:16"/>
Apr 13 23:02:16 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:16 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:02:16 user nova-compute[71269]:       <target dev="tap29e91af8-5b"/>
Apr 13 23:02:16 user nova-compute[71269]:     </interface>
Apr 13 23:02:16 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:02:16 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/console.log" append="off"/>
Apr 13 23:02:16 user nova-compute[71269]:     </serial>
Apr 13 23:02:16 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:02:16 user nova-compute[71269]:     <video>
Apr 13 23:02:16 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:16 user nova-compute[71269]:     </video>
Apr 13 23:02:16 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:02:16 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:02:16 user nova-compute[71269]:     </rng>
Apr 13 23:02:16 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:02:16 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:02:16 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:02:16 user nova-compute[71269]:     </memballoon>
Apr 13 23:02:16 user nova-compute[71269]:   </devices>
Apr 13 23:02:16 user nova-compute[71269]: </domain>
Apr 13 23:02:16 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-18447064',display_name='tempest-ServersNegativeTestJSON-server-18447064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-18447064',id=23,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-hffexq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:15Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=dc473fb8-e574-4e49-b860-3ae0066cc9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG os_vif [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29e91af8-5b, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29e91af8-5b, col_values=(('external_ids', {'iface-id': '29e91af8-5b8e-4872-9ee0-9cc4b79fb647', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8e:16', 'vm-uuid': 'dc473fb8-e574-4e49-b860-3ae0066cc9b8'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:16 user nova-compute[71269]: INFO os_vif [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b')
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:02:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] No VIF found with MAC fa:16:3e:d8:8e:16, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:02:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Updated VIF entry in instance network info cache for port 29e91af8-5b8e-4872-9ee0-9cc4b79fb647. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:02:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Updating instance_info_cache with network_info: [{"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6fa6238-4f97-4bab-a37f-7357294bc053 req-cf0c696b-0d1c-4cae-9946-cc20781fab35 service nova] Releasing lock "refresh_cache-dc473fb8-e574-4e49-b860-3ae0066cc9b8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:18 user nova-compute[71269]: WARNING nova.compute.manager [req-9d5dad4f-5069-4d1f-8eff-f499828b8fd7 req-a061d334-c3b2-41aa-b5e2-98d3859d530e service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state building and task_state spawning.
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-changed-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing instance network info cache due to event network-changed-302fbc22-4c9a-48dc-bf40-4aec87dd4b92. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Acquiring lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Acquired lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Refreshing network info cache for port 302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updated VIF entry in instance network info cache for port 302fbc22-4c9a-48dc-bf40-4aec87dd4b92. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-82972e20-4e2d-48b3-91c6-75a4ae96f92a req-177c87d0-f9d9-44f5-87f0-a754ae8c148c service nova] Releasing lock "refresh_cache-1783d976-5b1b-466b-abb1-fd4b5c9c01aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426940.4434288, dc473fb8-e574-4e49-b860-3ae0066cc9b8 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] VM Resumed (Lifecycle Event)
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Instance spawned successfully.
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:20 user nova-compute[71269]: WARNING nova.compute.manager [req-530e9720-c2c4-45ac-92a0-e3b6cc301a06 req-d92559af-4602-4bb2-98f3-a1e65a6aaf48 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state building and task_state spawning.
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426940.4491081, dc473fb8-e574-4e49-b860-3ae0066cc9b8 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] VM Started (Lifecycle Event)
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 13 23:02:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:20 user nova-compute[71269]: INFO nova.compute.manager [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Took 6.25 seconds to build instance.
Apr 13 23:02:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-ab1caa56-4a22-47ea-9acf-c40803ea6886 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.344s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:21 user nova-compute[71269]: INFO nova.compute.manager [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Terminating instance
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-c0c860fc-6994-4c04-b6ef-7c505510e4d9 req-91e016c2-8bd8-4b17-9732-c1fa3411b121 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-599054c9-625a-40af-a475-d349be667dc4 req-38e1038d-0cca-4a8c-ac28-59a2711e9888 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-5d649918-bdcb-4b16-b701-1dbad3722881 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:22 user nova-compute[71269]: WARNING nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-693e2c7e-e759-4e34-a3fb-ef2e51eecaca for instance with vm_state active and task_state deleting.
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-d7199650-e2d2-4349-af5f-357b9f511835 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:22 user nova-compute[71269]: WARNING nova.compute.manager [req-6b4beb65-91dc-4ed6-a754-6fbdf9b14975 req-340ad977-442c-40e8-8bb3-c1eec56e8029 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-d7199650-e2d2-4349-af5f-357b9f511835 for instance with vm_state active and task_state deleting.
Apr 13 23:02:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Instance destroyed successfully.
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lazy-loading 'resources' on Instance uuid 1783d976-5b1b-466b-abb1-fd4b5c9c01aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap302fbc22-4c, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:5d:da,bridge_name='br-int',has_traffic_filtering=True,id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92,network=Network(bbe00596-d1c9-459b-9276-49ccd37f3e2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap302fbc22-4c')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693e2c7e-e7, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8c:af,bridge_name='br-int',has_traffic_filtering=True,id=693e2c7e-e759-4e34-a3fb-ef2e51eecaca,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap693e2c7e-e7')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d649918-bd, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1b:ce,bridge_name='br-int',has_traffic_filtering=True,id=5d649918-bdcb-4b16-b701-1dbad3722881,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d649918-bd')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "d7199650-e2d2-4349-af5f-357b9f511835", "address": "fa:16:3e:6b:fd:11", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7199650-e2", "ovs_interfaceid": "d7199650-e2d2-4349-af5f-357b9f511835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7199650-e2, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fd:11,bridge_name='br-int',has_traffic_filtering=True,id=d7199650-e2d2-4349-af5f-357b9f511835,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7199650-e2')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8b103f-6a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e8b103f-6a1d-41f9-aab0-8c17817026a5,network=Network(005f05f3-94f9-4eab-a534-b1d78fcee111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8b103f-6a')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5c60c56-d8, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:18:51,bridge_name='br-int',has_traffic_filtering=True,id=b5c60c56-d874-48fe-be4f-5dd41322809f,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5c60c56-d8')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1085018677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1085018677',id=20,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13e0kjJbtbY60ySppxgw6utN/5wgpw5UUjbqpOGOcRlf+S/lSy0BnEHMUilpSpgpjkcfk9FALPaWoCa5XqSNnmWxcBfHCU1OBrDw1FlY3tDnzq2rougxq8syrbcJ1mSg==',key_name='tempest-keypair-1127154613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3774169387c4fc59f3300af1a033087',ramdisk_id='',reservation_id='r-ouu89d67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2028021468',owner_user_name='tempest-TaggedBootDevicesTest-2028021468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c16f28e6923c4fbfbb3c295377b6f9d8',uuid=1783d976-5b1b-466b-abb1-fd4b5c9c01aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converting VIF {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20766522-a6, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:23 user nova-compute[71269]: INFO os_vif [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=20766522-a6dc-49b0-a925-09cbcce46937,network=Network(53468967-a88c-4b4c-b3d9-26569f561a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20766522-a6')
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnQrOoUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4744597-f279-4882-8673-3ded6e055470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]: iSNS:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]: STATIC:
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: FIRMWARE:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:02:23 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:02:23 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb985227-5b6f-41c0-b01b-2772c871c34a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc16136-6260-49e0-b680-13b43191db49]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb4fe7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71'): ({'sdh'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Removing single pathed devices sdh {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae3dfa-cbb8-4382-9dbc-bd13cb75e6b2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97d3401-df03-489f-87cb-25bac8d0b2a4]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flushing IO for device /dev/sdh {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2691f12-340f-4a2c-bc19-3f695962098e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a918b-8e5f-4861-a84b-378e25d0c4d2]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] SCSI volumes sdh have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 for instance with vm_state active and task_state deleting.
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-7e8b103f-6a1d-41f9-aab0-8c17817026a5 for instance with vm_state active and task_state deleting.
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-b5c60c56-d874-48fe-be4f-5dd41322809f for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING nova.compute.manager [req-a4d75fc8-78dd-4deb-a44b-d9a86c16bc4d req-e909f7ec-cd54-49d8-b8e0-85a6d761ec7a service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-b5c60c56-d874-48fe-be4f-5dd41322809f for instance with vm_state active and task_state deleting.
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f82ad-a1df-4527-a401-1c06a5d575da]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024fc39-ee6a-49c7-b691-ced039baf395]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260]
Apr 13 23:02:23 user nova-compute[71269]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71, portal: 172.16.0.220,3260] successful.
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc7e45c-5d77-4435-81cc-54d2f33bcd71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b15b4-4ace-4cfa-8ba7-ed82167c68da]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== disconnect_volume: return (315ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBAvlSFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ffb7a2-de16-45b7-873c-c1e505edc3ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]: iSNS:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]: STATIC:
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:02:23 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:23 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:23 user nova-compute[71269]: FIRMWARE:
Apr 13 23:02:23 user nova-compute[71269]: No targets found.
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:02:23 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:02:23 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b4414-919b-4813-80ec-efe16a24a926]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3841b-8ff5-4637-98b1-ba8b56495a4b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:23 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78'): ({'sdf'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Removing single pathed devices sdf {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446850a-dbc3-49bf-9a47-f5b069689b96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:23 user nova-compute[71269]: WARNING nova.compute.manager [req-53dbfdfc-e1c8-45ef-914d-4a416c93dfd6 req-37a5f79c-9981-404f-aab0-5ca25214f3f5 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-5d649918-bdcb-4b16-b701-1dbad3722881 for instance with vm_state active and task_state deleting.
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[748956f9-8504-43f5-a9cb-8ecdb3c0fe97]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flushing IO for device /dev/sdf {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe661f70-f1be-4f8b-881b-3597ce430c54]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8d936-6153-4b0a-a42e-0694b50f7b02]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eafaf9f-332f-4151-831d-0ae3ef13ee8f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39133e-3185-41ee-b131-7f76e169e282]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260]
Apr 13 23:02:24 user nova-compute[71269]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78, portal: 172.16.0.220,3260] successful.
Apr 13 23:02:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:748dfe3c-bd51-40d5-b219-46a5183d5d78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a21cab-5bfd-44b5-bac3-f5ade2fe028d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== disconnect_volume: return (330ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYHnwRck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:02:24 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17027e82-6e69-4d85-aa08-bec5a6080abf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:02:24 user nova-compute[71269]: No targets found.
Apr 13 23:02:24 user nova-compute[71269]: iSNS:
Apr 13 23:02:24 user nova-compute[71269]: No targets found.
Apr 13 23:02:24 user nova-compute[71269]: STATIC:
Apr 13 23:02:24 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77
Apr 13 23:02:24 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:24 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:24 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:02:24 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:02:24 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:02:24 user nova-compute[71269]: FIRMWARE:
Apr 13 23:02:24 user nova-compute[71269]: No targets found.
Apr 13 23:02:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:02:24 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:02:24 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84724840-2a6e-4197-84a9-d451ffe1f41d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2833d80a-5a32-4cc2-a05f-0b593556c3c5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:24 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:24 user nova-compute[71269]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 (non-flash)
Apr 13 23:02:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77'): ({'sdg'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Removing single pathed devices sdg {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14acd1-eb4f-4c29-8895-39e8d0cba864]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[111f44a9-bf93-4571-8475-9a50f9e01da9]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Flushing IO for device /dev/sdg {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d75ff4-4afd-4f52-8c9a-58ed6cd5c1b4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed6185-4c0e-45e4-9897-33f7ec92c4c6]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] SCSI volumes sdg have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f25236c-5caa-4864-9a07-a7f1322b89b1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712aeca-2e63-476e-9dfd-8fe13ed7ebc7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260]
Apr 13 23:02:24 user nova-compute[71269]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77, portal: 172.16.0.220,3260] successful.
Apr 13 23:02:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af258cda-4dd1-4033-92da-e5227f03ab77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447918f-f45d-44c8-b0ec-56531635f546]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] <== disconnect_volume: return (300ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:02:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Deleting instance files /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa_del
Apr 13 23:02:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Deletion of /opt/stack/data/nova/instances/1783d976-5b1b-466b-abb1-fd4b5c9c01aa_del complete
Apr 13 23:02:24 user nova-compute[71269]: INFO nova.compute.manager [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Took 3.35 seconds to destroy the instance on the hypervisor.
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-unplugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-unplugged-20766522-a6dc-49b0-a925-09cbcce46937 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Acquiring lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] No waiting events found dispatching network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:24 user nova-compute[71269]: WARNING nova.compute.manager [req-8a446357-dfca-416c-9748-8e1830d717d5 req-616c51d5-eca0-4532-aeb5-103479c410c0 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received unexpected event network-vif-plugged-20766522-a6dc-49b0-a925-09cbcce46937 for instance with vm_state active and task_state deleting.
Apr 13 23:02:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:25 user nova-compute[71269]: INFO nova.compute.manager [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Terminating instance
Apr 13 23:02:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-deleted-d7199650-e2d2-4349-af5f-357b9f511835 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:26 user nova-compute[71269]: INFO nova.compute.manager [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Neutron deleted interface d7199650-e2d2-4349-af5f-357b9f511835; detaching it from the instance and deleting it from the info cache
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.network.neutron [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20766522-a6dc-49b0-a925-09cbcce46937", "address": "fa:16:3e:8f:bc:42", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20766522-a6", "ovs_interfaceid": "20766522-a6dc-49b0-a925-09cbcce46937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-ebb9c065-cfbf-46d4-bb15-e7d56eab7397 req-6a3d9c34-8062-4513-a84d-18f1d82b98ac service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Detach interface failed, port_id=d7199650-e2d2-4349-af5f-357b9f511835, reason: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:02:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Instance destroyed successfully.
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'resources' on Instance uuid 92e1fa88-8896-4198-af4d-56d44baf3b9b {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-399970293',display_name='tempest-AttachVolumeTestJSON-server-399970293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-399970293',id=3,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYszYLHqm3TSsYG53y7yrRrp/BSu53oOaIQJh8QFzIdZE1yR8v0colL3Wr0n1bH725AWkN7xrgjULBo24JmIla1q/OA7HRKEOPTBBakoM2MAG7p8Rv2IXQuLAG6ZgBdKg==',key_name='tempest-keypair-361428277',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-g1ne5qbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=92e1fa88-8896-4198-af4d-56d44baf3b9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "address": "fa:16:3e:03:14:a3", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c47f47-2e", "ovs_interfaceid": "94c47f47-2ee7-46d0-858d-a5ff3270a80b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG os_vif [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c47f47-2e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:26 user nova-compute[71269]: INFO os_vif [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=94c47f47-2ee7-46d0-858d-a5ff3270a80b,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c47f47-2e')
Apr 13 23:02:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Deleting instance files /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b_del
Apr 13 23:02:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Deletion of /opt/stack/data/nova/instances/92e1fa88-8896-4198-af4d-56d44baf3b9b_del complete
Apr 13 23:02:26 user nova-compute[71269]: INFO nova.compute.manager [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-unplugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Acquiring lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] No waiting events found dispatching network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:26 user nova-compute[71269]: WARNING nova.compute.manager [req-0b20e52e-aeac-4992-be16-1c77ae35561e req-461f67b1-94f5-48c6-9915-54a1205fabed service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received unexpected event network-vif-plugged-94c47f47-2ee7-46d0-858d-a5ff3270a80b for instance with vm_state active and task_state deleting.
Apr 13 23:02:27 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:27 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Took 1.44 seconds to deallocate network for instance.
Apr 13 23:02:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-deleted-20766522-a6dc-49b0-a925-09cbcce46937 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:28 user nova-compute[71269]: INFO nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Neutron deleted interface 20766522-a6dc-49b0-a925-09cbcce46937; detaching it from the instance and deleting it from the info cache
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "address": "fa:16:3e:47:5d:da", "network": {"id": "bbe00596-d1c9-459b-9276-49ccd37f3e2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-271545720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap302fbc22-4c", "ovs_interfaceid": "302fbc22-4c9a-48dc-bf40-4aec87dd4b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:28 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Deleted allocations for instance 92e1fa88-8896-4198-af4d-56d44baf3b9b
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Detach interface failed, port_id=20766522-a6dc-49b0-a925-09cbcce46937, reason: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Received event network-vif-deleted-94c47f47-2ee7-46d0-858d-a5ff3270a80b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-deleted-302fbc22-4c9a-48dc-bf40-4aec87dd4b92 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:28 user nova-compute[71269]: INFO nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Neutron deleted interface 302fbc22-4c9a-48dc-bf40-4aec87dd4b92; detaching it from the instance and deleting it from the info cache
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [{"id": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "address": "fa:16:3e:12:8c:af", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693e2c7e-e7", "ovs_interfaceid": "693e2c7e-e759-4e34-a3fb-ef2e51eecaca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d649918-bdcb-4b16-b701-1dbad3722881", "address": "fa:16:3e:b3:1b:ce", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d649918-bd", "ovs_interfaceid": "5d649918-bdcb-4b16-b701-1dbad3722881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "address": "fa:16:3e:68:ce:ba", "network": {"id": "005f05f3-94f9-4eab-a534-b1d78fcee111", "bridge": "br-int", "label": "tempest-device-tagging-net1-120329147", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8b103f-6a", "ovs_interfaceid": "7e8b103f-6a1d-41f9-aab0-8c17817026a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5c60c56-d874-48fe-be4f-5dd41322809f", "address": "fa:16:3e:ce:18:51", "network": {"id": "53468967-a88c-4b4c-b3d9-26569f561a7b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1084779765", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a3774169387c4fc59f3300af1a033087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5c60c56-d8", "ovs_interfaceid": "b5c60c56-d874-48fe-be4f-5dd41322809f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-b32cc642-9f80-4838-a05c-b104fa9a9c7e req-ec953348-658c-4e3c-82b0-3250b7bc9747 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Detach interface failed, port_id=302fbc22-4c9a-48dc-bf40-4aec87dd4b92, reason: Instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aedd23b7-828d-45fd-9c11-013fb09badcf tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "92e1fa88-8896-4198-af4d-56d44baf3b9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:28 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:28 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Took 4.14 seconds to deallocate network for instance.
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:29 user nova-compute[71269]: INFO nova.compute.manager [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Terminating instance
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Instance destroyed successfully.
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.objects.instance [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'resources' on Instance uuid 4435b0c4-7292-4348-bcd9-a712a2df3e91 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458287941',display_name='tempest-AttachVolumeNegativeTest-server-1458287941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458287941',id=19,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdIn2aTmD4XbBsFMXMHNsWX5qBMfL70kIjVQgqdNLj3BfmoaBPPsv0YDGx2+i2qNmJlXMHeZYj/opWigP9CFsZryFVOF7OKgBHSIywAoBb74kwwJDqv4tRlH1o7PgrM9Q==',key_name='tempest-keypair-286597101',keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-y2u05gxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=4435b0c4-7292-4348-bcd9-a712a2df3e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "address": "fa:16:3e:4c:71:82", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c62453-7a", "ovs_interfaceid": "79c62453-7ae2-480d-aa21-a5f26dfb0763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG os_vif [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79c62453-7a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:29 user nova-compute[71269]: INFO os_vif [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:71:82,bridge_name='br-int',has_traffic_filtering=True,id=79c62453-7ae2-480d-aa21-a5f26dfb0763,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c62453-7a')
Apr 13 23:02:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Deleting instance files /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91_del
Apr 13 23:02:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Deletion of /opt/stack/data/nova/instances/4435b0c4-7292-4348-bcd9-a712a2df3e91_del complete
Apr 13 23:02:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:29 user nova-compute[71269]: INFO nova.compute.manager [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 23:02:29 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:02:29 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-deleted-7e8b103f-6a1d-41f9-aab0-8c17817026a5 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Received event network-vif-deleted-b5c60c56-d874-48fe-be4f-5dd41322809f {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:30 user nova-compute[71269]: WARNING nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state active and task_state deleting.
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:30 user nova-compute[71269]: WARNING nova.compute.manager [req-6d4adf3f-5bc9-403c-9cff-4688794834a9 req-35978248-084a-4039-af4b-366067637652 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state active and task_state deleting.
Apr 13 23:02:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:31 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Took 1.27 seconds to deallocate network for instance.
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:31 user nova-compute[71269]: INFO nova.compute.manager [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Took 2.65 seconds to detach 3 volumes for instance.
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.240s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:31 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Deleted allocations for instance 4435b0c4-7292-4348-bcd9-a712a2df3e91
Apr 13 23:02:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-32ef76fb-745c-4a8d-a800-1634f2d39cf8 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:31 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:32 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Deleted allocations for instance 1783d976-5b1b-466b-abb1-fd4b5c9c01aa
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-00b2d6b7-0fc3-452d-8d2c-17a6a1ccb0c1 tempest-TaggedBootDevicesTest-2028021468 tempest-TaggedBootDevicesTest-2028021468-project-member] Lock "1783d976-5b1b-466b-abb1-fd4b5c9c01aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.083s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:32 user nova-compute[71269]: WARNING nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state deleted and task_state None.
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:32 user nova-compute[71269]: WARNING nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-unplugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state deleted and task_state None.
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Acquiring lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] Lock "4435b0c4-7292-4348-bcd9-a712a2df3e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] No waiting events found dispatching network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:32 user nova-compute[71269]: WARNING nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received unexpected event network-vif-plugged-79c62453-7ae2-480d-aa21-a5f26dfb0763 for instance with vm_state deleted and task_state None.
Apr 13 23:02:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-cb4c2305-610e-419c-9470-199aa0756215 req-5cd75797-2702-484d-8ddf-3886a9465992 service nova] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Received event network-vif-deleted-79c62453-7ae2-480d-aa21-a5f26dfb0763 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:38 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426943.0929875, 1783d976-5b1b-466b-abb1-fd4b5c9c01aa => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:38 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] VM Stopped (Lifecycle Event)
Apr 13 23:02:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e38e2ce4-e57a-4edb-a10a-11e09bcfc76d None None] [instance: 1783d976-5b1b-466b-abb1-fd4b5c9c01aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:02:39 user nova-compute[71269]: INFO nova.compute.claims [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Claim successful on node user
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:02:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:02:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:02:39 user nova-compute[71269]: INFO nova.virt.block_device [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Booting with volume 7e14d684-74a4-43e0-aa03-5dc4d626d990 at /dev/vda
Apr 13 23:02:39 user nova-compute[71269]: DEBUG nova.policy [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG os_brick.utils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:02:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[276dc845-c407-4e1d-b465-a76320a80d86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d63fc4-d9a3-47f4-b37b-30eb76c773ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[526c37ab-748f-48c3-834f-a3fca3a4c7d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012b30e-94fb-4b5e-80ce-3b0af5b6ebd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:02:40 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:02:40 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e785a8-fdf2-4026-85ec-060ee191556c]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG os_brick.utils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updating existing volume attachment record: 718b0203-58a2-41f0-a5f5-dbe3ce7d2c09 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:02:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Successfully created port: e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426946.225341, 92e1fa88-8896-4198-af4d-56d44baf3b9b => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:41 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] VM Stopped (Lifecycle Event)
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4e612c2a-62a3-4435-9458-8ac7c01feb92 None None] [instance: 92e1fa88-8896-4198-af4d-56d44baf3b9b] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Successfully updated port: e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-changed-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Refreshing instance network info cache due to event network-changed-e6bb2fdf-5afa-4160-b657-34c1bafa0b23. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Acquiring lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:02:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updating instance_info_cache with network_info: [{"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Instance network_info: |[{"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Acquired lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Refreshing network info cache for port e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updated VIF entry in instance network info cache for port e6bb2fdf-5afa-4160-b657-34c1bafa0b23. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updating instance_info_cache with network_info: [{"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-abeff579-ee22-4141-9c41-6f91bb8c652c req-2057a200-e59f-477f-861c-a053c948aba4 service nova] Releasing lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:02:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Creating image(s)
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Ensure instance console log exists: /opt/stack/data/nova/instances/06ecf305-65ca-4752-984c-cb7094593493/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Start _get_guest_xml network_info=[{"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '718b0203-58a2-41f0-a5f5-dbe3ce7d2c09', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06ecf305-65ca-4752-984c-cb7094593493', 'attached_at': '', 'detached_at': '', 'volume_id': '7e14d684-74a4-43e0-aa03-5dc4d626d990', 'serial': '7e14d684-74a4-43e0-aa03-5dc4d626d990'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:02:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:02:44 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:02:44 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:02:44 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac1e706-80b2-44fe-ab24-1e5c98cf4112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:02:44 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546fb16-0551-4ee3-9b4a-7b706f2fb802]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990] added
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac19bbd-0d7a-4fb7-955d-acb813c4a0f2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c10a20-5fb3-4531-a718-214f59922c9f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgIkJYPK {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgIkJYPK" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe740f-5294-4956-9ba0-320f127ed4a3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgIkJYPK'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050c9e8-9a02-4e09-91d5-4a8043e47339]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7bbb8d-ebbe-499d-bd62-90db05c77351]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426949.8175488, 4435b0c4-7292-4348-bcd9-a712a2df3e91 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:44 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] VM Stopped (Lifecycle Event)
Apr 13 23:02:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-defebd7b-689b-4c42-b02c-4bccd0be37c2 None None] [instance: 4435b0c4-7292-4348-bcd9-a712a2df3e91] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d05f73-3455-41cd-9805-28e45f0791e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]
Apr 13 23:02:44 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ed3f3-46ae-4c10-a7a3-529e73adec02]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e090c6-58e4-4a9d-b4a0-7afe7e5a4aaa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:02:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaaa3bc-093d-407d-8024-a337c5b3ef0f]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:02:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:02:45 user nova-compute[71269]: INFO nova.compute.claims [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Claim successful on node user
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:02:45 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.policy [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fad76e3a6e154feaa62d95f6e7d1ce1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf532d1c87a34b8cbde0f162688f7cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:02:45 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Creating image(s)
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "/opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "/opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "/opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26364323934333234', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364323934333234', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2073414277',display_name='tempest-TestVolumeBootPattern-server-2073414277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2073414277',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-0h9sjdme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:40Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=06ecf305-65ca-4752-984c-cb7094593493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:45 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid 06ecf305-65ca-4752-984c-cb7094593493 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:02:46 user nova-compute[71269]:   <uuid>06ecf305-65ca-4752-984c-cb7094593493</uuid>
Apr 13 23:02:46 user nova-compute[71269]:   <name>instance-00000018</name>
Apr 13 23:02:46 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:02:46 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:02:46 user nova-compute[71269]:   <metadata>
Apr 13 23:02:46 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:02:46 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:02:46 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-server-2073414277</nova:name>
Apr 13 23:02:46 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:02:44</nova:creationTime>
Apr 13 23:02:46 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:02:46 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:02:46 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:02:46 user nova-compute[71269]:       <nova:owner>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 23:02:46 user nova-compute[71269]:       </nova:owner>
Apr 13 23:02:46 user nova-compute[71269]:       <nova:ports>
Apr 13 23:02:46 user nova-compute[71269]:         <nova:port uuid="e6bb2fdf-5afa-4160-b657-34c1bafa0b23">
Apr 13 23:02:46 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 23:02:46 user nova-compute[71269]:         </nova:port>
Apr 13 23:02:46 user nova-compute[71269]:       </nova:ports>
Apr 13 23:02:46 user nova-compute[71269]:     </nova:instance>
Apr 13 23:02:46 user nova-compute[71269]:   </metadata>
Apr 13 23:02:46 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:02:46 user nova-compute[71269]:     <system>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="serial">06ecf305-65ca-4752-984c-cb7094593493</entry>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="uuid">06ecf305-65ca-4752-984c-cb7094593493</entry>
Apr 13 23:02:46 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:02:46 user nova-compute[71269]:     </system>
Apr 13 23:02:46 user nova-compute[71269]:   </sysinfo>
Apr 13 23:02:46 user nova-compute[71269]:   <os>
Apr 13 23:02:46 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:02:46 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:02:46 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:02:46 user nova-compute[71269]:   </os>
Apr 13 23:02:46 user nova-compute[71269]:   <features>
Apr 13 23:02:46 user nova-compute[71269]:     <acpi/>
Apr 13 23:02:46 user nova-compute[71269]:     <apic/>
Apr 13 23:02:46 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:02:46 user nova-compute[71269]:   </features>
Apr 13 23:02:46 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:02:46 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:02:46 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:02:46 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:02:46 user nova-compute[71269]:   </clock>
Apr 13 23:02:46 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:02:46 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:02:46 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:02:46 user nova-compute[71269]:   </cpu>
Apr 13 23:02:46 user nova-compute[71269]:   <devices>
Apr 13 23:02:46 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:02:46 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:02:46 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:02:46 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:02:46 user nova-compute[71269]:       <serial>7e14d684-74a4-43e0-aa03-5dc4d626d990</serial>
Apr 13 23:02:46 user nova-compute[71269]:     </disk>
Apr 13 23:02:46 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:02:46 user nova-compute[71269]:       <mac address="fa:16:3e:4a:77:f6"/>
Apr 13 23:02:46 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:46 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:02:46 user nova-compute[71269]:       <target dev="tape6bb2fdf-5a"/>
Apr 13 23:02:46 user nova-compute[71269]:     </interface>
Apr 13 23:02:46 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:02:46 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/06ecf305-65ca-4752-984c-cb7094593493/console.log" append="off"/>
Apr 13 23:02:46 user nova-compute[71269]:     </serial>
Apr 13 23:02:46 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:02:46 user nova-compute[71269]:     <video>
Apr 13 23:02:46 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:46 user nova-compute[71269]:     </video>
Apr 13 23:02:46 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:02:46 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:02:46 user nova-compute[71269]:     </rng>
Apr 13 23:02:46 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:02:46 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:02:46 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:02:46 user nova-compute[71269]:     </memballoon>
Apr 13 23:02:46 user nova-compute[71269]:   </devices>
Apr 13 23:02:46 user nova-compute[71269]: </domain>
Apr 13 23:02:46 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2073414277',display_name='tempest-TestVolumeBootPattern-server-2073414277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2073414277',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-0h9sjdme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:40Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=06ecf305-65ca-4752-984c-cb7094593493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG os_vif [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6bb2fdf-5a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6bb2fdf-5a, col_values=(('external_ids', {'iface-id': 'e6bb2fdf-5afa-4160-b657-34c1bafa0b23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:77:f6', 'vm-uuid': '06ecf305-65ca-4752-984c-cb7094593493'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:46 user nova-compute[71269]: INFO os_vif [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a')
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:4a:77:f6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.virt.images [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 0e299bea-bdd5-4988-a5dc-230b7bdfa5d3 was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.part /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Successfully created port: 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.part /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.converted" returned: 0 in 0.186s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.812s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:46 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04,backing_fmt=raw /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04,backing_fmt=raw /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk 1073741824" returned: 0 in 0.047s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "e3870c1914c8c2405ed4bbb8fe233b99ef44dc04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Successfully updated port: 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing instance network info cache due to event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Cannot resize image /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'migration_context' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Ensure instance console log exists: /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e012813d-317e-46b9-b2f7-32a1743a3688 req-9171890f-e74e-475b-b209-0127b71daaa7 service nova] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance network_info: |[{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Start _get_guest_xml network_info=[{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T23:02:43Z,direct_url=<?>,disk_format='qcow2',id=0e299bea-bdd5-4988-a5dc-230b7bdfa5d3,min_disk=0,min_ram=0,name='tempest-scenario-img--1625292703',owner='cf532d1c87a34b8cbde0f162688f7cdb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T23:02:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': '0e299bea-bdd5-4988-a5dc-230b7bdfa5d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:02:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:48 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T23:02:43Z,direct_url=<?>,disk_format='qcow2',id=0e299bea-bdd5-4988-a5dc-230b7bdfa5d3,min_disk=0,min_ram=0,name='tempest-scenario-img--1625292703',owner='cf532d1c87a34b8cbde0f162688f7cdb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T23:02:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-663169904',display_name='tempest-TestMinimumBasicScenario-server-663169904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-663169904',id=25,image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sGHCLoLvO1a6S/Zt/PEdT7BPKf9ERdMM0FJv9xWt+SMt3ws6LpVhbc/hXC0h4+aCtYPmwhyCNg25B0Fn+l5Ab22CCK9eEL6zQEp3JGKV2S3bXOgj0WJVeX+40Z2Y9eg==',key_name='tempest-TestMinimumBasicScenario-1134301175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-faapp9hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:46Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=70c7e35a-9a30-44ff-bb5f-74d122bf08d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'pci_devices' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:02:48 user nova-compute[71269]:   <uuid>70c7e35a-9a30-44ff-bb5f-74d122bf08d2</uuid>
Apr 13 23:02:48 user nova-compute[71269]:   <name>instance-00000019</name>
Apr 13 23:02:48 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:02:48 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:02:48 user nova-compute[71269]:   <metadata>
Apr 13 23:02:48 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:02:48 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:name>tempest-TestMinimumBasicScenario-server-663169904</nova:name>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:02:48</nova:creationTime>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:02:48 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:02:48 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:owner>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:user uuid="fad76e3a6e154feaa62d95f6e7d1ce1c">tempest-TestMinimumBasicScenario-146514025-project-member</nova:user>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:project uuid="cf532d1c87a34b8cbde0f162688f7cdb">tempest-TestMinimumBasicScenario-146514025</nova:project>
Apr 13 23:02:48 user nova-compute[71269]:       </nova:owner>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:root type="image" uuid="0e299bea-bdd5-4988-a5dc-230b7bdfa5d3"/>
Apr 13 23:02:48 user nova-compute[71269]:       <nova:ports>
Apr 13 23:02:48 user nova-compute[71269]:         <nova:port uuid="95b6eed4-ff6e-493e-a912-d263def87a82">
Apr 13 23:02:48 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:02:48 user nova-compute[71269]:         </nova:port>
Apr 13 23:02:48 user nova-compute[71269]:       </nova:ports>
Apr 13 23:02:48 user nova-compute[71269]:     </nova:instance>
Apr 13 23:02:48 user nova-compute[71269]:   </metadata>
Apr 13 23:02:48 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:02:48 user nova-compute[71269]:     <system>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="serial">70c7e35a-9a30-44ff-bb5f-74d122bf08d2</entry>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="uuid">70c7e35a-9a30-44ff-bb5f-74d122bf08d2</entry>
Apr 13 23:02:48 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:02:48 user nova-compute[71269]:     </system>
Apr 13 23:02:48 user nova-compute[71269]:   </sysinfo>
Apr 13 23:02:48 user nova-compute[71269]:   <os>
Apr 13 23:02:48 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:02:48 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:02:48 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:02:48 user nova-compute[71269]:   </os>
Apr 13 23:02:48 user nova-compute[71269]:   <features>
Apr 13 23:02:48 user nova-compute[71269]:     <acpi/>
Apr 13 23:02:48 user nova-compute[71269]:     <apic/>
Apr 13 23:02:48 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:02:48 user nova-compute[71269]:   </features>
Apr 13 23:02:48 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:02:48 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:02:48 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:02:48 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:02:48 user nova-compute[71269]:   </clock>
Apr 13 23:02:48 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:02:48 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:02:48 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:02:48 user nova-compute[71269]:   </cpu>
Apr 13 23:02:48 user nova-compute[71269]:   <devices>
Apr 13 23:02:48 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:02:48 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:02:48 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk"/>
Apr 13 23:02:48 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:02:48 user nova-compute[71269]:     </disk>
Apr 13 23:02:48 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:02:48 user nova-compute[71269]:       <mac address="fa:16:3e:00:78:c3"/>
Apr 13 23:02:48 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:48 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:02:48 user nova-compute[71269]:       <target dev="tap95b6eed4-ff"/>
Apr 13 23:02:48 user nova-compute[71269]:     </interface>
Apr 13 23:02:48 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:02:48 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/console.log" append="off"/>
Apr 13 23:02:48 user nova-compute[71269]:     </serial>
Apr 13 23:02:48 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:02:48 user nova-compute[71269]:     <video>
Apr 13 23:02:48 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:02:48 user nova-compute[71269]:     </video>
Apr 13 23:02:48 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:02:48 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:02:48 user nova-compute[71269]:     </rng>
Apr 13 23:02:48 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:02:48 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:02:48 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:02:48 user nova-compute[71269]:     </memballoon>
Apr 13 23:02:48 user nova-compute[71269]:   </devices>
Apr 13 23:02:48 user nova-compute[71269]: </domain>
Apr 13 23:02:48 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-663169904',display_name='tempest-TestMinimumBasicScenario-server-663169904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-663169904',id=25,image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sGHCLoLvO1a6S/Zt/PEdT7BPKf9ERdMM0FJv9xWt+SMt3ws6LpVhbc/hXC0h4+aCtYPmwhyCNg25B0Fn+l5Ab22CCK9eEL6zQEp3JGKV2S3bXOgj0WJVeX+40Z2Y9eg==',key_name='tempest-TestMinimumBasicScenario-1134301175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-faapp9hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:02:46Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=70c7e35a-9a30-44ff-bb5f-74d122bf08d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG os_vif [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95b6eed4-ff, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95b6eed4-ff, col_values=(('external_ids', {'iface-id': '95b6eed4-ff6e-493e-a912-d263def87a82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:78:c3', 'vm-uuid': '70c7e35a-9a30-44ff-bb5f-74d122bf08d2'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: INFO os_vif [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff')
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No VIF found with MAC fa:16:3e:00:78:c3, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] No waiting events found dispatching network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:49 user nova-compute[71269]: WARNING nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received unexpected event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance with vm_state building and task_state spawning.
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] No waiting events found dispatching network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:49 user nova-compute[71269]: WARNING nova.compute.manager [req-51a4bc62-6f5f-4b37-846c-a98ae335ef42 req-161aa46f-3608-4f2a-a28b-7a036452ed8b service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received unexpected event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance with vm_state building and task_state spawning.
Apr 13 23:02:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:49 user nova-compute[71269]: WARNING nova.compute.manager [req-1aff6a47-af87-438f-afe1-3258c6c32271 req-859e9d0b-df3a-437e-adc6-7293cc3d9b83 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state building and task_state spawning.
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426969.9989722, 06ecf305-65ca-4752-984c-cb7094593493 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] VM Resumed (Lifecycle Event)
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Instance spawned successfully.
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426970.0051339, 06ecf305-65ca-4752-984c-cb7094593493 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] VM Started (Lifecycle Event)
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 13 23:02:50 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:50 user nova-compute[71269]: INFO nova.compute.manager [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Took 10.87 seconds to build instance.
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f5be5869-3b5c-46b3-ba23-9c45996228bf tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.960s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:02:51 user nova-compute[71269]: WARNING nova.compute.manager [req-6db21428-73b8-4f71-a474-5fdc3bba7f71 req-2a596a9f-4388-4185-a6cb-03321c7f25f8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state building and task_state spawning.
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426971.8871815, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:51 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] VM Resumed (Lifecycle Event)
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:02:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance spawned successfully.
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:02:51 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426971.9028158, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:02:51 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] VM Started (Lifecycle Event)
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:02:52 user nova-compute[71269]: INFO nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 13 23:02:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:02:52 user nova-compute[71269]: INFO nova.compute.manager [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Took 6.85 seconds to build instance.
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e01343fe-0594-483c-980b-cf9b17b5c5d2 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.943s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:53 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:53 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7837MB free_disk=26.32101058959961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 06ecf305-65ca-4752-984c-cb7094593493 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:02:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:02:54 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:02:54 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:02:54 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:02:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:02:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4991-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:02:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:09 user nova-compute[71269]: INFO nova.compute.manager [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Terminating instance
Apr 13 23:03:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-unplugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] No waiting events found dispatching network-vif-unplugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-7df4b8a2-efd1-4514-b6bc-3fd8ee1a0da3 req-e0e784b2-8e4b-49d3-9e9c-91231376081b service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-unplugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:03:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Instance destroyed successfully.
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lazy-loading 'resources' on Instance uuid a2979e2c-7ef9-4cbd-8daf-dedd5103f857 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-940156379',display_name='tempest-VolumesNegativeTest-instance-940156379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-940156379',id=21,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:01:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea52ea14393449b3b0ce5a8ed973e435',ramdisk_id='',reservation_id='r-j1xeqh6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-704025732',owner_user_name='tempest-VolumesNegativeTest-704025732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:01:27Z,user_data=None,user_id='6eea00459cc046129decc442a6996ee0',uuid=a2979e2c-7ef9-4cbd-8daf-dedd5103f857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converting VIF {"id": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "address": "fa:16:3e:fe:f7:11", "network": {"id": "215f5ee5-1cf6-4a5c-a24a-0b648d352706", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ae05bac4793407ea3c17cd2e4fb8b5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5f289c-7a", "ovs_interfaceid": "5f5f289c-7a04-41f3-b5e8-73e45d3ac536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG os_vif [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5f289c-7a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:03:10 user nova-compute[71269]: INFO os_vif [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:f7:11,bridge_name='br-int',has_traffic_filtering=True,id=5f5f289c-7a04-41f3-b5e8-73e45d3ac536,network=Network(215f5ee5-1cf6-4a5c-a24a-0b648d352706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5f289c-7a')
Apr 13 23:03:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Deleting instance files /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857_del
Apr 13 23:03:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Deletion of /opt/stack/data/nova/instances/a2979e2c-7ef9-4cbd-8daf-dedd5103f857_del complete
Apr 13 23:03:10 user nova-compute[71269]: INFO nova.compute.manager [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 23:03:10 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:10 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Took 0.52 seconds to deallocate network for instance.
Apr 13 23:03:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:11 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Deleted allocations for instance a2979e2c-7ef9-4cbd-8daf-dedd5103f857
Apr 13 23:03:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c5882c2-e72f-47a5-9be7-771f63c6a210 tempest-VolumesNegativeTest-704025732 tempest-VolumesNegativeTest-704025732-project-member] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Acquiring lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] Lock "a2979e2c-7ef9-4cbd-8daf-dedd5103f857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] No waiting events found dispatching network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:11 user nova-compute[71269]: WARNING nova.compute.manager [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received unexpected event network-vif-plugged-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 for instance with vm_state deleted and task_state None.
Apr 13 23:03:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-7a39b182-b57f-4a8d-9aeb-57a6f70f1093 req-4158f2f8-ce87-41d4-992c-8f620bb00ace service nova] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Received event network-vif-deleted-5f5f289c-7a04-41f3-b5e8-73e45d3ac536 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:12 user nova-compute[71269]: INFO nova.compute.manager [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Unrescuing
Apr 13 23:03:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'flavor' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:13 user nova-compute[71269]: WARNING nova.compute.manager [req-0194edb1-7afe-483d-8568-7bd38ae9e391 req-1b08abe3-e032-4879-8c50-34c4022ff54c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:03:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance destroyed successfully.
Apr 13 23:03:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:15 user nova-compute[71269]: WARNING nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:03:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:15 user nova-compute[71269]: WARNING nova.compute.manager [req-f8a69062-19a6-497a-9e91-38c5c0451091 req-ada119d1-d517-48f4-a017-7de62b5f4dfa service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:03:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 31ec73b0-9b2a-4fc1-be85-4179075afdb8 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:03:16 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426996.9806044, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:16 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Resumed (Lifecycle Event)
Apr 13 23:03:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-090fbc8b-e116-4b02-9dad-38a8bbc69f2d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:17 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681426996.982063, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:17 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Started (Lifecycle Event)
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:17 user nova-compute[71269]: WARNING nova.compute.manager [req-0a6a15dd-3e38-4a77-8e8d-5153ee3c104c req-a11f034b-cbea-45ab-8724-3f00fdcade49 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state None.
Apr 13 23:03:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:03:19 user nova-compute[71269]: INFO nova.compute.claims [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Claim successful on node user
Apr 13 23:03:19 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:03:19 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:03:20 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.policy [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13b46af525dd45678b69207e93683ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0648ea953174a8cae6085ac24d92bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:03:20 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Creating image(s)
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "/opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "/opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "/opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.175s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk 1073741824" returned: 0 in 0.053s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Cannot resize image /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'migration_context' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Successfully created port: b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Ensure instance console log exists: /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Successfully updated port: b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquired lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-changed-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Refreshing instance network info cache due to event network-changed-b8721edc-dc82-4768-a1ae-894b8561f8a8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Acquiring lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing instance network info cache due to event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating instance_info_cache with network_info: [{"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Releasing lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Instance network_info: |[{"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Acquired lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Refreshing network info cache for port b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Start _get_guest_xml network_info=[{"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:03:22 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:22 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1360471313',display_name='tempest-AttachVolumeTestJSON-server-1360471313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1360471313',id=26,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfUWVI8IOPtgGPQLd2ogb+LB+C/kCsbiJob8LDBPVAPjT7tXncvXjQQwIlebgqjND7LJaONDLwpT9nVZvik8n9ZW1Lw+oRM7rk6w4HCK0B0/C97upBdLDNGJcWvMc8+RA==',key_name='tempest-keypair-229071683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-ldtw84zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=381385a1-4c41-4479-b5cc-0222c9a7c2aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'pci_devices' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:03:22 user nova-compute[71269]:   <uuid>381385a1-4c41-4479-b5cc-0222c9a7c2aa</uuid>
Apr 13 23:03:22 user nova-compute[71269]:   <name>instance-0000001a</name>
Apr 13 23:03:22 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:03:22 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:03:22 user nova-compute[71269]:   <metadata>
Apr 13 23:03:22 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:03:22 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeTestJSON-server-1360471313</nova:name>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:03:22</nova:creationTime>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:03:22 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:03:22 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:owner>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:user uuid="13b46af525dd45678b69207e93683ac4">tempest-AttachVolumeTestJSON-118072319-project-member</nova:user>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:project uuid="d0648ea953174a8cae6085ac24d92bb1">tempest-AttachVolumeTestJSON-118072319</nova:project>
Apr 13 23:03:22 user nova-compute[71269]:       </nova:owner>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:03:22 user nova-compute[71269]:       <nova:ports>
Apr 13 23:03:22 user nova-compute[71269]:         <nova:port uuid="b8721edc-dc82-4768-a1ae-894b8561f8a8">
Apr 13 23:03:22 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 23:03:22 user nova-compute[71269]:         </nova:port>
Apr 13 23:03:22 user nova-compute[71269]:       </nova:ports>
Apr 13 23:03:22 user nova-compute[71269]:     </nova:instance>
Apr 13 23:03:22 user nova-compute[71269]:   </metadata>
Apr 13 23:03:22 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:03:22 user nova-compute[71269]:     <system>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="serial">381385a1-4c41-4479-b5cc-0222c9a7c2aa</entry>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="uuid">381385a1-4c41-4479-b5cc-0222c9a7c2aa</entry>
Apr 13 23:03:22 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:03:22 user nova-compute[71269]:     </system>
Apr 13 23:03:22 user nova-compute[71269]:   </sysinfo>
Apr 13 23:03:22 user nova-compute[71269]:   <os>
Apr 13 23:03:22 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:03:22 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:03:22 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:03:22 user nova-compute[71269]:   </os>
Apr 13 23:03:22 user nova-compute[71269]:   <features>
Apr 13 23:03:22 user nova-compute[71269]:     <acpi/>
Apr 13 23:03:22 user nova-compute[71269]:     <apic/>
Apr 13 23:03:22 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:03:22 user nova-compute[71269]:   </features>
Apr 13 23:03:22 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:03:22 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:03:22 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:03:22 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:03:22 user nova-compute[71269]:   </clock>
Apr 13 23:03:22 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:03:22 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:03:22 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:03:22 user nova-compute[71269]:   </cpu>
Apr 13 23:03:22 user nova-compute[71269]:   <devices>
Apr 13 23:03:22 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:03:22 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:03:22 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk"/>
Apr 13 23:03:22 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:03:22 user nova-compute[71269]:     </disk>
Apr 13 23:03:22 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:03:22 user nova-compute[71269]:       <mac address="fa:16:3e:0a:4d:0a"/>
Apr 13 23:03:22 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:22 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:03:22 user nova-compute[71269]:       <target dev="tapb8721edc-dc"/>
Apr 13 23:03:22 user nova-compute[71269]:     </interface>
Apr 13 23:03:22 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:03:22 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/console.log" append="off"/>
Apr 13 23:03:22 user nova-compute[71269]:     </serial>
Apr 13 23:03:22 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:03:22 user nova-compute[71269]:     <video>
Apr 13 23:03:22 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:22 user nova-compute[71269]:     </video>
Apr 13 23:03:22 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:03:22 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:03:22 user nova-compute[71269]:     </rng>
Apr 13 23:03:22 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:03:22 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:03:22 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:03:22 user nova-compute[71269]:     </memballoon>
Apr 13 23:03:22 user nova-compute[71269]:   </devices>
Apr 13 23:03:22 user nova-compute[71269]: </domain>
Apr 13 23:03:22 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1360471313',display_name='tempest-AttachVolumeTestJSON-server-1360471313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1360471313',id=26,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfUWVI8IOPtgGPQLd2ogb+LB+C/kCsbiJob8LDBPVAPjT7tXncvXjQQwIlebgqjND7LJaONDLwpT9nVZvik8n9ZW1Lw+oRM7rk6w4HCK0B0/C97upBdLDNGJcWvMc8+RA==',key_name='tempest-keypair-229071683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-ldtw84zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=381385a1-4c41-4479-b5cc-0222c9a7c2aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_vif [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8721edc-dc, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8721edc-dc, col_values=(('external_ids', {'iface-id': 'b8721edc-dc82-4768-a1ae-894b8561f8a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:4d:0a', 'vm-uuid': '381385a1-4c41-4479-b5cc-0222c9a7c2aa'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:22 user nova-compute[71269]: INFO os_vif [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc')
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No VIF found with MAC fa:16:3e:0a:4d:0a, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:22 user nova-compute[71269]: INFO nova.compute.manager [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Attaching volume 642f82bc-0cb0-4600-b66e-9d8ab2b0a083 to /dev/vdb
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.utils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[102404d7-7686-43fe-8182-4611cd4bbae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b1a3d-2c52-4027-b4c3-0436cd12eca7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7fe09-f29e-4e07-9363-71d418e46348]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc12223-40d4-4c6a-b827-ede9de09de9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:03:22 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1260537-ad5b-4043-ab60-5273dc2302a2]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG os_brick.utils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating existing volume attachment record: 5c86170a-c7a0-47e6-bc19-b18b8659785f {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updated VIF entry in instance network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2906974b-c22c-4376-833e-10b9e28a5b1f req-235fa9ce-1f6f-4943-b88d-33c5e50e44f2 service nova] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updated VIF entry in instance network info cache for port b8721edc-dc82-4768-a1ae-894b8561f8a8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating instance_info_cache with network_info: [{"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-15856e0b-81ce-489e-ab02-207e48238d94 req-04f8c151-12ee-477c-96c8-39eb8a058fc4 service nova] Releasing lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:03:23 user nova-compute[71269]: INFO nova.compute.claims [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Claim successful on node user
Apr 13 23:03:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:03:23 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] No waiting events found dispatching network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:24 user nova-compute[71269]: WARNING nova.compute.manager [req-dffc550f-9e2f-4311-9ad9-a92acfa663ac req-564a11e8-f021-49d9-a80a-8d78a7e66f43 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received unexpected event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance with vm_state building and task_state spawning.
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:03:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.policy [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98594f3f6ccf4ffdbfd91bcf192d936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ccac99656842aca44f9f1eb7aa167a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:03:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Creating image(s)
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "/opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "/opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.154s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk 1073741824" returned: 0 in 0.045s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Cannot resize image /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.objects.instance [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'migration_context' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Ensure instance console log exists: /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:25 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Successfully created port: 4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:03:25 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681426990.3091094, a2979e2c-7ef9-4cbd-8daf-dedd5103f857 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:25 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] VM Stopped (Lifecycle Event)
Apr 13 23:03:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d74dc474-7e21-4674-9b42-c34d894c7e30 None None] [instance: a2979e2c-7ef9-4cbd-8daf-dedd5103f857] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427006.0396745, 381385a1-4c41-4479-b5cc-0222c9a7c2aa => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] VM Resumed (Lifecycle Event)
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Instance spawned successfully.
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] No waiting events found dispatching network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:26 user nova-compute[71269]: WARNING nova.compute.manager [req-369dd1f4-e4e3-4415-aa48-f8d2d0c52ea5 req-39658f44-f96b-4555-8fc4-4e9047fd2d76 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received unexpected event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance with vm_state building and task_state spawning.
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427006.0458376, 381385a1-4c41-4479-b5cc-0222c9a7c2aa => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] VM Started (Lifecycle Event)
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:26 user nova-compute[71269]: INFO nova.compute.manager [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Took 6.68 seconds to build instance.
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-52c5a80d-088f-40d1-be23-3aca58cd9eba tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Successfully updated port: 4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquired lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-changed-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Refreshing instance network info cache due to event network-changed-4eef61bd-3529-4ab4-9f58-881fac9cc1d6. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:03:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Acquiring lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating instance_info_cache with network_info: [{"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Releasing lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Instance network_info: |[{"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Acquired lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Refreshing network info cache for port 4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Start _get_guest_xml network_info=[{"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:03:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947473118',display_name='tempest-AttachVolumeNegativeTest-server-947473118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947473118',id=27,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnOM9oAIvYAaqonstAu0i79x5C14LxizYJ582GKlS7wdPZc54wVauzPY4OtlQHFLxduXboFLe6QmDOJ72hstQUoK/NDE7whGNJS43ASabOJL/ItpHphysZg+R09NEMAOQ==',key_name='tempest-keypair-661625581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-gqjeeb4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=454fafc9-4b6f-40c3-80fa-d590fb946889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'pci_devices' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BanCmNSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:03:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:03:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:03:27 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:03:27 user nova-compute[71269]:   <uuid>454fafc9-4b6f-40c3-80fa-d590fb946889</uuid>
Apr 13 23:03:27 user nova-compute[71269]:   <name>instance-0000001b</name>
Apr 13 23:03:27 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:03:27 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:03:27 user nova-compute[71269]:   <metadata>
Apr 13 23:03:27 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:03:27 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeNegativeTest-server-947473118</nova:name>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:03:27</nova:creationTime>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:03:27 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:03:27 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:owner>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:user uuid="98594f3f6ccf4ffdbfd91bcf192d936e">tempest-AttachVolumeNegativeTest-704876090-project-member</nova:user>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:project uuid="85ccac99656842aca44f9f1eb7aa167a">tempest-AttachVolumeNegativeTest-704876090</nova:project>
Apr 13 23:03:27 user nova-compute[71269]:       </nova:owner>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:03:27 user nova-compute[71269]:       <nova:ports>
Apr 13 23:03:27 user nova-compute[71269]:         <nova:port uuid="4eef61bd-3529-4ab4-9f58-881fac9cc1d6">
Apr 13 23:03:27 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:03:27 user nova-compute[71269]:         </nova:port>
Apr 13 23:03:27 user nova-compute[71269]:       </nova:ports>
Apr 13 23:03:27 user nova-compute[71269]:     </nova:instance>
Apr 13 23:03:27 user nova-compute[71269]:   </metadata>
Apr 13 23:03:27 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:03:27 user nova-compute[71269]:     <system>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="serial">454fafc9-4b6f-40c3-80fa-d590fb946889</entry>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="uuid">454fafc9-4b6f-40c3-80fa-d590fb946889</entry>
Apr 13 23:03:27 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:03:27 user nova-compute[71269]:     </system>
Apr 13 23:03:27 user nova-compute[71269]:   </sysinfo>
Apr 13 23:03:27 user nova-compute[71269]:   <os>
Apr 13 23:03:27 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:03:27 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:03:27 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:03:27 user nova-compute[71269]:   </os>
Apr 13 23:03:27 user nova-compute[71269]:   <features>
Apr 13 23:03:27 user nova-compute[71269]:     <acpi/>
Apr 13 23:03:27 user nova-compute[71269]:     <apic/>
Apr 13 23:03:27 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:03:27 user nova-compute[71269]:   </features>
Apr 13 23:03:27 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:03:27 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:03:27 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:03:27 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:03:27 user nova-compute[71269]:   </clock>
Apr 13 23:03:27 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:03:27 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:03:27 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:03:27 user nova-compute[71269]:   </cpu>
Apr 13 23:03:27 user nova-compute[71269]:   <devices>
Apr 13 23:03:27 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:03:27 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:03:27 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk"/>
Apr 13 23:03:27 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:03:27 user nova-compute[71269]:     </disk>
Apr 13 23:03:27 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:03:27 user nova-compute[71269]:       <mac address="fa:16:3e:d3:ef:a2"/>
Apr 13 23:03:27 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:27 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:03:27 user nova-compute[71269]:       <target dev="tap4eef61bd-35"/>
Apr 13 23:03:27 user nova-compute[71269]:     </interface>
Apr 13 23:03:27 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:03:27 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/console.log" append="off"/>
Apr 13 23:03:27 user nova-compute[71269]:     </serial>
Apr 13 23:03:27 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:03:27 user nova-compute[71269]:     <video>
Apr 13 23:03:27 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:27 user nova-compute[71269]:     </video>
Apr 13 23:03:27 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:03:27 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:03:27 user nova-compute[71269]:     </rng>
Apr 13 23:03:27 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:03:27 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:03:27 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:03:27 user nova-compute[71269]:     </memballoon>
Apr 13 23:03:27 user nova-compute[71269]:   </devices>
Apr 13 23:03:27 user nova-compute[71269]: </domain>
Apr 13 23:03:27 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947473118',display_name='tempest-AttachVolumeNegativeTest-server-947473118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947473118',id=27,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnOM9oAIvYAaqonstAu0i79x5C14LxizYJ582GKlS7wdPZc54wVauzPY4OtlQHFLxduXboFLe6QmDOJ72hstQUoK/NDE7whGNJS43ASabOJL/ItpHphysZg+R09NEMAOQ==',key_name='tempest-keypair-661625581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-gqjeeb4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=454fafc9-4b6f-40c3-80fa-d590fb946889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_vif [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eef61bd-35, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4eef61bd-35, col_values=(('external_ids', {'iface-id': '4eef61bd-3529-4ab4-9f58-881fac9cc1d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ef:a2', 'vm-uuid': '454fafc9-4b6f-40c3-80fa-d590fb946889'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d5453-a371-486b-ad64-ad9d3327aad2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:03:27 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:27 user nova-compute[71269]: INFO os_vif [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35')
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6390ee04-d694-4bc0-8467-b965f123620a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083] added
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad52765-0e06-41c5-9368-06264b01b2d0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac43f47-99ac-4080-9641-7a5843a03985]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BanCmNSb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:d3:ef:a2, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BanCmNSb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c18b1f-7755-42d4-ade1-f774ea1886e4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BanCmNSb'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5fc576-6f41-42e5-b93c-269559233757]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c217988a-ecb1-4f48-9942-3cb620060ce6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dd6d1-3491-47c6-a017-e9fad4dbd283]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260]
Apr 13 23:03:27 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260] successful.
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74b01d-758b-486f-b625-ec381eefeb50]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca55aca-9103-4a79-9918-7b06253278b9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:03:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:03:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f41e79-581d-4df1-9a86-f4f20da72a18]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BanCmNSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updated VIF entry in instance network info cache for port 4eef61bd-3529-4ab4-9f58-881fac9cc1d6. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating instance_info_cache with network_info: [{"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99514a43-16ae-446a-99f3-0c252c10605a req-eca4b74f-cb7c-4100-9492-52576cd1b065 service nova] Releasing lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23136393238323939', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136393238323939', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:03:29 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:03:29 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:03:29 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:03:29 user nova-compute[71269]:   <serial>642f82bc-0cb0-4600-b66e-9d8ab2b0a083</serial>
Apr 13 23:03:29 user nova-compute[71269]: </disk>
Apr 13 23:03:29 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] No waiting events found dispatching network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:29 user nova-compute[71269]: WARNING nova.compute.manager [req-f22ce8b4-9bd0-4614-8745-3b5e13fdced5 req-5e1dd6c4-2ba2-44fb-bf54-b9648da92ff2 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received unexpected event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance with vm_state building and task_state spawning.
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:d0:65:0c, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:03:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bac21f6-0577-4b3f-8114-1853b9c49078 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.635s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:31 user nova-compute[71269]: INFO nova.compute.manager [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Rescuing
Apr 13 23:03:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] No waiting events found dispatching network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:31 user nova-compute[71269]: WARNING nova.compute.manager [req-b2f566c0-3326-446d-aa1a-a4eee4403f6e req-2246d4f9-5b20-4168-824f-bd640349ba77 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received unexpected event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance with vm_state building and task_state spawning.
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427011.8499122, 454fafc9-4b6f-40c3-80fa-d590fb946889 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] VM Resumed (Lifecycle Event)
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:03:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Instance spawned successfully.
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:03:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427011.8549027, 454fafc9-4b6f-40c3-80fa-d590fb946889 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] VM Started (Lifecycle Event)
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:03:32 user nova-compute[71269]: INFO nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Took 7.80 seconds to spawn the instance on the hypervisor.
Apr 13 23:03:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:32 user nova-compute[71269]: INFO nova.compute.manager [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Took 8.71 seconds to build instance.
Apr 13 23:03:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fa7652b3-bb91-45cd-be28-5174e622ee9a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.815s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG nova.network.neutron [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance destroyed successfully.
Apr 13 23:03:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Attempting rescue
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 23:03:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Creating image(s)
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'trusted_certs' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:33 user nova-compute[71269]: WARNING nova.compute.manager [req-03b2380e-e04a-47ba-b78a-401c01da7e66 req-7613f896-e8cb-408e-8802-3251c0fcec1f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.204s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue" returned: 0 in 0.059s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'migration_context' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start _get_guest_xml network_info=[{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:d0:65:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'numa_topology' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:33 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:33 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:03:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'vcpu_model' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127216369',display_name='tempest-ServerRescueNegativeTestJSON-server-1127216369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127216369',id=22,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vlH4K190ZLaXGZADGTKyJqq1HrjF8mcn+GStKL4ZJ0L5vSiY+ekY/NcmigKtITRdMzH4ykVfwffOwzTyyJICm8WdBeAnwGlDcy6UYkDS+DFs4nMGVpTbq7hSi2P8hhA==',key_name='tempest-keypair-1129500402',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-l38vxe9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=deb24b5e-f858-4068-88c5-3c7708c7e195,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:d0:65:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "vif_mac": "fa:16:3e:d0:65:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'pci_devices' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:03:34 user nova-compute[71269]:   <uuid>deb24b5e-f858-4068-88c5-3c7708c7e195</uuid>
Apr 13 23:03:34 user nova-compute[71269]:   <name>instance-00000016</name>
Apr 13 23:03:34 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:03:34 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:03:34 user nova-compute[71269]:   <metadata>
Apr 13 23:03:34 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:03:34 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1127216369</nova:name>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:03:33</nova:creationTime>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:03:34 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:03:34 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:owner>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:user uuid="28cb6d8d6e3d4ef7aa53bb17faf495c4">tempest-ServerRescueNegativeTestJSON-258614246-project-member</nova:user>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:project uuid="5b6a1fccc07f4f5a8f8f8617ae03955d">tempest-ServerRescueNegativeTestJSON-258614246</nova:project>
Apr 13 23:03:34 user nova-compute[71269]:       </nova:owner>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:03:34 user nova-compute[71269]:       <nova:ports>
Apr 13 23:03:34 user nova-compute[71269]:         <nova:port uuid="c7f804a4-0e8d-4d99-a547-5c9252cb872c">
Apr 13 23:03:34 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 23:03:34 user nova-compute[71269]:         </nova:port>
Apr 13 23:03:34 user nova-compute[71269]:       </nova:ports>
Apr 13 23:03:34 user nova-compute[71269]:     </nova:instance>
Apr 13 23:03:34 user nova-compute[71269]:   </metadata>
Apr 13 23:03:34 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:03:34 user nova-compute[71269]:     <system>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="serial">deb24b5e-f858-4068-88c5-3c7708c7e195</entry>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="uuid">deb24b5e-f858-4068-88c5-3c7708c7e195</entry>
Apr 13 23:03:34 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:03:34 user nova-compute[71269]:     </system>
Apr 13 23:03:34 user nova-compute[71269]:   </sysinfo>
Apr 13 23:03:34 user nova-compute[71269]:   <os>
Apr 13 23:03:34 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:03:34 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:03:34 user nova-compute[71269]:   </os>
Apr 13 23:03:34 user nova-compute[71269]:   <features>
Apr 13 23:03:34 user nova-compute[71269]:     <acpi/>
Apr 13 23:03:34 user nova-compute[71269]:     <apic/>
Apr 13 23:03:34 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:03:34 user nova-compute[71269]:   </features>
Apr 13 23:03:34 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:03:34 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:03:34 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:03:34 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:03:34 user nova-compute[71269]:   </clock>
Apr 13 23:03:34 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:03:34 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:03:34 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:03:34 user nova-compute[71269]:   </cpu>
Apr 13 23:03:34 user nova-compute[71269]:   <devices>
Apr 13 23:03:34 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:03:34 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:03:34 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue"/>
Apr 13 23:03:34 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:03:34 user nova-compute[71269]:     </disk>
Apr 13 23:03:34 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:03:34 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:03:34 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk"/>
Apr 13 23:03:34 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:03:34 user nova-compute[71269]:     </disk>
Apr 13 23:03:34 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:03:34 user nova-compute[71269]:       <mac address="fa:16:3e:d0:65:0c"/>
Apr 13 23:03:34 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:34 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:03:34 user nova-compute[71269]:       <target dev="tapc7f804a4-0e"/>
Apr 13 23:03:34 user nova-compute[71269]:     </interface>
Apr 13 23:03:34 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:03:34 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/console.log" append="off"/>
Apr 13 23:03:34 user nova-compute[71269]:     </serial>
Apr 13 23:03:34 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:03:34 user nova-compute[71269]:     <video>
Apr 13 23:03:34 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:03:34 user nova-compute[71269]:     </video>
Apr 13 23:03:34 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:03:34 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:03:34 user nova-compute[71269]:     </rng>
Apr 13 23:03:34 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:03:34 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:03:34 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:03:34 user nova-compute[71269]:     </memballoon>
Apr 13 23:03:34 user nova-compute[71269]:   </devices>
Apr 13 23:03:34 user nova-compute[71269]: </domain>
Apr 13 23:03:34 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:03:34 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance destroyed successfully.
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] No VIF found with MAC fa:16:3e:d0:65:0c, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6734bb37-bbd1-4c01-abe2-3fb8013dae86 req-9569541c-f01f-41b7-877a-d991aee60bf1 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:37 user nova-compute[71269]: WARNING nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:03:37 user nova-compute[71269]: WARNING nova.compute.manager [req-c49bcc14-68d9-478c-b75d-955b8ff1a866 req-50d71352-111f-4e46-b417-516060499c80 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state active and task_state rescuing.
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for deb24b5e-f858-4068-88c5-3c7708c7e195 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427018.031539, deb24b5e-f858-4068-88c5-3c7708c7e195 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Resumed (Lifecycle Event)
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-58d6d60e-8540-41de-97ff-4bfa3f6649c6 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427018.0342505, deb24b5e-f858-4068-88c5-3c7708c7e195 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:03:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Started (Lifecycle Event)
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:03:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:03:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:44 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:03:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:03:46 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:48 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:49 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:50 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:03:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:53 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:53 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7599MB free_disk=26.24123764038086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 06ecf305-65ca-4752-984c-cb7094593493 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:03:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:03:55 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:03:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:03:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:05 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:04:05 user nova-compute[71269]: INFO nova.compute.claims [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Claim successful on node user
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:04:06 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:04:06 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Creating image(s)
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "/opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "/opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "/opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG nova.policy [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71593deacbd74fea9fc2faf5a9b08877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8a3c684b0414336b2ca770eb1f3ab17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk 1073741824" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Cannot resize image /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'migration_context' on Instance uuid 47dce1cc-c872-41f3-81af-acfc6ccabe18 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Ensure instance console log exists: /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Successfully created port: 6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:04:08 user nova-compute[71269]: INFO nova.compute.claims [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Claim successful on node user
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Successfully updated port: 6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquired lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-changed-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Refreshing instance network info cache due to event network-changed-6ab4b160-3952-4332-9443-7f743c5feb6c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Acquiring lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Updating instance_info_cache with network_info: [{"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Releasing lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Instance network_info: |[{"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Acquired lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.neutron [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Refreshing network info cache for port 6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Start _get_guest_xml network_info=[{"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:04:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:04:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1989795804',display_name='tempest-ServersNegativeTestJSON-server-1989795804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1989795804',id=28,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-phokkcsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:07Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=47dce1cc-c872-41f3-81af-acfc6ccabe18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'pci_devices' on Instance uuid 47dce1cc-c872-41f3-81af-acfc6ccabe18 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:04:09 user nova-compute[71269]:   <uuid>47dce1cc-c872-41f3-81af-acfc6ccabe18</uuid>
Apr 13 23:04:09 user nova-compute[71269]:   <name>instance-0000001c</name>
Apr 13 23:04:09 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:04:09 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:04:09 user nova-compute[71269]:   <metadata>
Apr 13 23:04:09 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:04:09 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:name>tempest-ServersNegativeTestJSON-server-1989795804</nova:name>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:04:08</nova:creationTime>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:04:09 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:04:09 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:owner>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:user uuid="71593deacbd74fea9fc2faf5a9b08877">tempest-ServersNegativeTestJSON-1433854176-project-member</nova:user>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:project uuid="d8a3c684b0414336b2ca770eb1f3ab17">tempest-ServersNegativeTestJSON-1433854176</nova:project>
Apr 13 23:04:09 user nova-compute[71269]:       </nova:owner>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:04:09 user nova-compute[71269]:       <nova:ports>
Apr 13 23:04:09 user nova-compute[71269]:         <nova:port uuid="6ab4b160-3952-4332-9443-7f743c5feb6c">
Apr 13 23:04:09 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 23:04:09 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:09 user nova-compute[71269]:       </nova:ports>
Apr 13 23:04:09 user nova-compute[71269]:     </nova:instance>
Apr 13 23:04:09 user nova-compute[71269]:   </metadata>
Apr 13 23:04:09 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:04:09 user nova-compute[71269]:     <system>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="serial">47dce1cc-c872-41f3-81af-acfc6ccabe18</entry>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="uuid">47dce1cc-c872-41f3-81af-acfc6ccabe18</entry>
Apr 13 23:04:09 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:04:09 user nova-compute[71269]:     </system>
Apr 13 23:04:09 user nova-compute[71269]:   </sysinfo>
Apr 13 23:04:09 user nova-compute[71269]:   <os>
Apr 13 23:04:09 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:04:09 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:04:09 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:04:09 user nova-compute[71269]:   </os>
Apr 13 23:04:09 user nova-compute[71269]:   <features>
Apr 13 23:04:09 user nova-compute[71269]:     <acpi/>
Apr 13 23:04:09 user nova-compute[71269]:     <apic/>
Apr 13 23:04:09 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:04:09 user nova-compute[71269]:   </features>
Apr 13 23:04:09 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:04:09 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:04:09 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:04:09 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:04:09 user nova-compute[71269]:   </clock>
Apr 13 23:04:09 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:04:09 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:04:09 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:04:09 user nova-compute[71269]:   </cpu>
Apr 13 23:04:09 user nova-compute[71269]:   <devices>
Apr 13 23:04:09 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:04:09 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:04:09 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk"/>
Apr 13 23:04:09 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:04:09 user nova-compute[71269]:     </disk>
Apr 13 23:04:09 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:09 user nova-compute[71269]:       <mac address="fa:16:3e:36:9c:71"/>
Apr 13 23:04:09 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:09 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:09 user nova-compute[71269]:       <target dev="tap6ab4b160-39"/>
Apr 13 23:04:09 user nova-compute[71269]:     </interface>
Apr 13 23:04:09 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:04:09 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/console.log" append="off"/>
Apr 13 23:04:09 user nova-compute[71269]:     </serial>
Apr 13 23:04:09 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:04:09 user nova-compute[71269]:     <video>
Apr 13 23:04:09 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:09 user nova-compute[71269]:     </video>
Apr 13 23:04:09 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:04:09 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:04:09 user nova-compute[71269]:     </rng>
Apr 13 23:04:09 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:04:09 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:04:09 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:04:09 user nova-compute[71269]:     </memballoon>
Apr 13 23:04:09 user nova-compute[71269]:   </devices>
Apr 13 23:04:09 user nova-compute[71269]: </domain>
Apr 13 23:04:09 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1989795804',display_name='tempest-ServersNegativeTestJSON-server-1989795804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1989795804',id=28,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-phokkcsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:07Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=47dce1cc-c872-41f3-81af-acfc6ccabe18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_vif [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ab4b160-39, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ab4b160-39, col_values=(('external_ids', {'iface-id': '6ab4b160-3952-4332-9443-7f743c5feb6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9c:71', 'vm-uuid': '47dce1cc-c872-41f3-81af-acfc6ccabe18'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:09 user nova-compute[71269]: INFO os_vif [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39')
Apr 13 23:04:09 user nova-compute[71269]: INFO nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Booting with volume ca331d15-300c-4c30-b73c-3ec9156d8097 at /dev/vda
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] No VIF found with MAC fa:16:3e:36:9c:71, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c804ae-fc2c-4540-bac2-862fcac0aae0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f6956-71ec-4a74-a4ae-44a91a754100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c91ce13-5335-4d93-b62f-b7487cb0dba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[512ce198-6050-4a1f-b70e-488af19164a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.policy [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fc4aba6767a4af9899ac437ab183df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822a2f291ff497aaaf66c26ed6afc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:09 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40875fe4-81e7-447f-ae9c-c6b038c9b45c]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating existing volume attachment record: 34112e83-fec7-49ec-8c9e-3f47c5f42ddd {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.network.neutron [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Updated VIF entry in instance network info cache for port 6ab4b160-3952-4332-9443-7f743c5feb6c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG nova.network.neutron [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Updating instance_info_cache with network_info: [{"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-36341375-7ead-46bf-aa9a-ab1d95784725 req-ee33c1ce-648d-49c0-8ab1-9527dd1fc7b2 service nova] Releasing lock "refresh_cache-47dce1cc-c872-41f3-81af-acfc6ccabe18" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully created port: 03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] No waiting events found dispatching network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:10 user nova-compute[71269]: WARNING nova.compute.manager [req-1f1348d7-0aa0-413d-9ed1-07bce6b1748a req-f0b36f9b-006a-42c2-9978-3ffe63e001dd service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received unexpected event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c for instance with vm_state building and task_state spawning.
Apr 13 23:04:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:11 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully created port: 56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:11 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully created port: d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully created port: ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427052.6697555, 47dce1cc-c872-41f3-81af-acfc6ccabe18 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] VM Resumed (Lifecycle Event)
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Instance spawned successfully.
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427052.6716523, 47dce1cc-c872-41f3-81af-acfc6ccabe18 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] VM Started (Lifecycle Event)
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] No waiting events found dispatching network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:12 user nova-compute[71269]: WARNING nova.compute.manager [req-f8761f14-65c9-46fa-9e69-891043b50ab0 req-1bac3ed1-2d41-466a-881a-6f7ed009f071 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received unexpected event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c for instance with vm_state building and task_state spawning.
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Took 6.22 seconds to spawn the instance on the hypervisor.
Apr 13 23:04:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:12 user nova-compute[71269]: INFO nova.compute.manager [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Took 6.93 seconds to build instance.
Apr 13 23:04:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e3f5652e-5886-4743-bcc4-1e7c7616ffe8 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.016s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully created port: a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:04:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:14 user nova-compute[71269]: INFO nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Booting with volume bdbff832-3d46-47da-8cae-62aa661d6ed4 at /dev/vdb
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c780c-82e8-4b8a-9c52-d173796f5c09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36878af-cd30-41d1-b3c8-c9e53e504bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[12294b02-37a7-4eb9-aa3f-3f6a6eb9175a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53393c4-8211-4b02-b5fe-4e19c9da4716]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:14 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6e058-6d59-47f4-be46-292fac26fc03]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating existing volume attachment record: e80207e8-d5fd-422f-bd7e-c4728a7cc380 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: 03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-03889253-8210-430d-b5a9-47d58c066803. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port 03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-722d92ba-5981-4835-9316-b1c770821b61 req-e7aa2feb-f7a3-4aac-866d-2e558e34d5e3 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: 77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-77b2db4a-b1bb-4628-a21a-1e24199cf117. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port 77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-ec62d21a-cab5-4c13-85df-0e7134cc11d3. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: 56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8525dfbe-e3f3-443f-9c12-4d79788551ee req-fe7f58c1-3ca5-4c2a-bdf0-9ff8e08ddf09 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-56cd2acf-5e6d-4703-a160-2cf983399d6b. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port 56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:19 user nova-compute[71269]: INFO nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Booting with volume c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 at /dev/vdc
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6fec08-3b69-4d02-8a29-9d2385c43e4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60eb868-36fa-4dd1-acae-c8954752e2dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[63900d09-9790-422a-936b-012dba5663cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43ff58-8374-4994-835d-ea5a6bba8a83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:19 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3073d94-d111-48ba-ac31-d6ded0334bf1]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG os_brick.utils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating existing volume attachment record: 49e2bbcc-1b9a-4991-a5a8-ef6b0b28cd4f {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-d6a692ff-983e-4d9b-abb2-45fee280cb60. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:20 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:20 user nova-compute[71269]: DEBUG nova.network.neutron [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51d975dc-3799-4430-a2ed-804f42482137 req-dcedb822-be11-4671-a7d6-a46d8bed3816 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-ad651a01-eb81-4baf-8b6c-ff196a729d67. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Successfully updated port: a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1e0a3c4f-c08a-460f-b84b-20bb004410e7 req-72e1604e-103a-4279-8d94-aa2ed0955d71 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:04:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance network_info: |[{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:04:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Creating image(s)
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Ensure instance console log exists: /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Start _get_guest_xml network_info=[{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '34112e83-fec7-49ec-8c9e-3f47c5f42ddd', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwJnhIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10290935-3f12-4e11-9495-f9c037e89875', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca331d15-300c-4c30-b73c-3ec9156d8097', 'serial': 'ca331d15-300c-4c30-b73c-3ec9156d8097'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'e80207e8-d5fd-422f-bd7e-c4728a7cc380', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTVJWGeD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10290935-3f12-4e11-9495-f9c037e89875', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdbff832-3d46-47da-8cae-62aa661d6ed4', 'serial': 'bdbff832-3d46-47da-8cae-62aa661d6ed4'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '49e2bbcc-1b9a-4991-a5a8-ef6b0b28cd4f', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqpcxEvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10290935-3f12-4e11-9495-f9c037e89875', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 'serial': 'c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:04:24 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:24 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwJnhIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:24 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:24 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:24 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.network.neutron [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updated VIF entry in instance network info cache for port a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG nova.network.neutron [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-595eb28a-a23c-4a76-b1da-2fec8c3c5016 req-0c77b890-b06c-47a6-aa28-7c2c41b1ce02 service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6708c-b25b-4644-97c1-a6d065744748]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:04:24 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f69fd2-6ea0-4982-a473-723ccba9b4ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097] added
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1198fc54-02f1-46d0-9f29-103ce8213fcd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e39615f-d817-4b7b-a247-1673a351c06e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwJnhIA {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjwJnhIA" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61d88d1-68f2-4aa5-8b1f-8ba96773da47]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjwJnhIA'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b8cc17-7840-40c7-b128-4bb0416b5ca8]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b69195-c4d3-49df-8dfe-edbb889e855e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d493710-bfd2-4d99-b5ac-1c397c2db016]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260]
Apr 13 23:04:24 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260] successful.
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2bd0a1-aaf3-4c28-a9d7-71da571680f2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce9e97-cfcd-4eae-bc91-f27345fdbb1d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:24 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee2be5e-1862-4732-aac1-f305fb1b7d23]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:04:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwJnhIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26334396235306362', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334396235306362', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTVJWGeD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:25 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced02fe4-cbb0-4781-8e2d-7092e8ae09a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:04:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55f4791-4430-4074-b438-a563c7dc0878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4] added
Apr 13 23:04:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fed07f-47b4-48c8-9469-e869dd761290]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9142f4fa-8486-4ddd-a962-0542e31e3465]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTVJWGeD {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTVJWGeD" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3e915-a634-45de-bb2c-9af4ebaac454]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTVJWGeD'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.097s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1b65a-00ed-4a19-b034-fa90e737936c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae9a3f-2fbf-4026-bed3-0dc37c153570]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e13534-9cdf-4039-ab13-170e46a35588]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260]
Apr 13 23:04:26 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260] successful.
Apr 13 23:04:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf5806a-b07a-41b4-920d-03e76aace188]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d25f39-81a2-490f-93fe-9e265d83b925]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04014dbe-8bab-4d27-b000-092958d65940]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:04:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTVJWGeD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23932386137653833', 'path': '/dev/sdf'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932386137653833', 'path': '/dev/sdf'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqpcxEvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:27 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e73a0-569c-41f0-b75a-bd14e444ff69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:04:27 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d02b4f-1987-40fd-ba27-c4686709b114]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1] added
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd43227-b994-4a6e-9718-2f22d9b1edf5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda531d7-8e30-41ed-b922-b56a9c20e89b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqpcxEvy {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqpcxEvy" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[954cc966-f875-4a31-a180-6b6ffb15f5de]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqpcxEvy'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[be964211-bf35-4892-aaa3-db169341f982]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaea3bd-1ebb-4ec6-9bc0-a17ef820bed6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b7254d-1646-4676-bcff-fc8fa707e048]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260]
Apr 13 23:04:27 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260] successful.
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d1d03a-3656-4973-b3e6-5829b8471690]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb23681-7750-4f6a-90ff-7858913c71e8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[120641f4-9162-4445-8fe2-e2d61ea84612]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:04:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqpcxEvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23735303863346364', 'path': '/dev/sdg'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735303863346364', 'path': '/dev/sdg'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lazy-loading 'pci_devices' on Instance uuid 10290935-3f12-4e11-9495-f9c037e89875 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:04:28 user nova-compute[71269]:   <uuid>10290935-3f12-4e11-9495-f9c037e89875</uuid>
Apr 13 23:04:28 user nova-compute[71269]:   <name>instance-0000001d</name>
Apr 13 23:04:28 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:04:28 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:04:28 user nova-compute[71269]:   <metadata>
Apr 13 23:04:28 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:04:28 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:name>tempest-device-tagging-server-747263411</nova:name>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:04:24</nova:creationTime>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:04:28 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:04:28 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:owner>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:user uuid="6fc4aba6767a4af9899ac437ab183df8">tempest-TaggedBootDevicesTest_v242-560099641-project-member</nova:user>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:project uuid="b822a2f291ff497aaaf66c26ed6afc79">tempest-TaggedBootDevicesTest_v242-560099641</nova:project>
Apr 13 23:04:28 user nova-compute[71269]:       </nova:owner>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:04:28 user nova-compute[71269]:       <nova:ports>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="03889253-8210-430d-b5a9-47d58c066803">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="77b2db4a-b1bb-4628-a21a-1e24199cf117">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="ec62d21a-cab5-4c13-85df-0e7134cc11d3">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="56cd2acf-5e6d-4703-a160-2cf983399d6b">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="d6a692ff-983e-4d9b-abb2-45fee280cb60">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="ad651a01-eb81-4baf-8b6c-ff196a729d67">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:         <nova:port uuid="a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e">
Apr 13 23:04:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 23:04:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:04:28 user nova-compute[71269]:       </nova:ports>
Apr 13 23:04:28 user nova-compute[71269]:     </nova:instance>
Apr 13 23:04:28 user nova-compute[71269]:   </metadata>
Apr 13 23:04:28 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:04:28 user nova-compute[71269]:     <system>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="serial">10290935-3f12-4e11-9495-f9c037e89875</entry>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="uuid">10290935-3f12-4e11-9495-f9c037e89875</entry>
Apr 13 23:04:28 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:04:28 user nova-compute[71269]:     </system>
Apr 13 23:04:28 user nova-compute[71269]:   </sysinfo>
Apr 13 23:04:28 user nova-compute[71269]:   <os>
Apr 13 23:04:28 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:04:28 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:04:28 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:04:28 user nova-compute[71269]:   </os>
Apr 13 23:04:28 user nova-compute[71269]:   <features>
Apr 13 23:04:28 user nova-compute[71269]:     <acpi/>
Apr 13 23:04:28 user nova-compute[71269]:     <apic/>
Apr 13 23:04:28 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:04:28 user nova-compute[71269]:   </features>
Apr 13 23:04:28 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:04:28 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:04:28 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:04:28 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:04:28 user nova-compute[71269]:   </clock>
Apr 13 23:04:28 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:04:28 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:04:28 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:04:28 user nova-compute[71269]:   </cpu>
Apr 13 23:04:28 user nova-compute[71269]:   <devices>
Apr 13 23:04:28 user nova-compute[71269]:     <disk type="file" device="cdrom">
Apr 13 23:04:28 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 23:04:28 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/disk.config"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="hda" bus="ide"/>
Apr 13 23:04:28 user nova-compute[71269]:     </disk>
Apr 13 23:04:28 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:04:28 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:04:28 user nova-compute[71269]:       <source dev="/dev/sde"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <serial>ca331d15-300c-4c30-b73c-3ec9156d8097</serial>
Apr 13 23:04:28 user nova-compute[71269]:     </disk>
Apr 13 23:04:28 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:04:28 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:04:28 user nova-compute[71269]:       <source dev="/dev/sdf"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <serial>bdbff832-3d46-47da-8cae-62aa661d6ed4</serial>
Apr 13 23:04:28 user nova-compute[71269]:     </disk>
Apr 13 23:04:28 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:04:28 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:04:28 user nova-compute[71269]:       <source dev="/dev/sdg"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="vdc" bus="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <serial>c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1</serial>
Apr 13 23:04:28 user nova-compute[71269]:     </disk>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:65:8d:fc"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tap03889253-82"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:18:34:31"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tap77b2db4a-b1"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:7c:2f:fb"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tapec62d21a-ca"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:82:50:a9"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tap56cd2acf-5e"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:1f:89:14"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tapd6a692ff-98"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:87:98:15"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tapad651a01-eb"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:04:28 user nova-compute[71269]:       <mac address="fa:16:3e:f0:17:6a"/>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:04:28 user nova-compute[71269]:       <target dev="tapa83e5bb1-2b"/>
Apr 13 23:04:28 user nova-compute[71269]:     </interface>
Apr 13 23:04:28 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:04:28 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/console.log" append="off"/>
Apr 13 23:04:28 user nova-compute[71269]:     </serial>
Apr 13 23:04:28 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:04:28 user nova-compute[71269]:     <video>
Apr 13 23:04:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:04:28 user nova-compute[71269]:     </video>
Apr 13 23:04:28 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:04:28 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:04:28 user nova-compute[71269]:     </rng>
Apr 13 23:04:28 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:04:28 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:04:28 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:04:28 user nova-compute[71269]:     </memballoon>
Apr 13 23:04:28 user nova-compute[71269]:   </devices>
Apr 13 23:04:28 user nova-compute[71269]: </domain>
Apr 13 23:04:28 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03889253-82, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03889253-82, col_values=(('external_ids', {'iface-id': '03889253-8210-430d-b5a9-47d58c066803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:8d:fc', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77b2db4a-b1, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77b2db4a-b1, col_values=(('external_ids', {'iface-id': '77b2db4a-b1bb-4628-a21a-1e24199cf117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:34:31', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec62d21a-ca, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec62d21a-ca, col_values=(('external_ids', {'iface-id': 'ec62d21a-cab5-4c13-85df-0e7134cc11d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:2f:fb', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56cd2acf-5e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56cd2acf-5e, col_values=(('external_ids', {'iface-id': '56cd2acf-5e6d-4703-a160-2cf983399d6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:50:a9', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6a692ff-98, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6a692ff-98, col_values=(('external_ids', {'iface-id': 'd6a692ff-983e-4d9b-abb2-45fee280cb60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:89:14', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad651a01-eb, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad651a01-eb, col_values=(('external_ids', {'iface-id': 'ad651a01-eb81-4baf-8b6c-ff196a729d67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:98:15', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb')
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa83e5bb1-2b, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa83e5bb1-2b, col_values=(('external_ids', {'iface-id': 'a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:17:6a', 'vm-uuid': '10290935-3f12-4e11-9495-f9c037e89875'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:28 user nova-compute[71269]: INFO os_vif [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b')
Apr 13 23:04:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] No BDM found with device name hda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:04:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:04:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] No VIF found with MAC fa:16:3e:65:8d:fc, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:04:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] No VIF found with MAC fa:16:3e:1f:89:14, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:04:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Using config drive
Apr 13 23:04:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Creating config drive at /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/disk.config
Apr 13 23:04:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb9l71nux {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb9l71nux" returned: 0 in 0.056s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:31 user nova-compute[71269]: WARNING nova.compute.manager [req-0b0c6462-d868-4996-809a-3e4a64f79f4c req-72b23c3c-eab5-4e74-a90d-b78d6abe0a88 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 for instance with vm_state building and task_state spawning.
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:31 user nova-compute[71269]: WARNING nova.compute.manager [req-d84f1489-d3bf-4074-8120-2c930130bd4d req-394dbe83-53bf-4d7d-9587-ea19829d2fd0 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance with vm_state building and task_state spawning.
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:32 user nova-compute[71269]: WARNING nova.compute.manager [req-f6b4108c-e57d-4d7f-ba7d-78248626caa4 req-e94956a6-eb09-483a-b144-206a3fac50f3 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b for instance with vm_state building and task_state spawning.
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-c162e4dc-92b7-481d-82d8-5bf83319a38c req-742028a7-78ef-46a3-8ea8-bf4bd01a2ac8 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:33 user nova-compute[71269]: WARNING nova.compute.manager [req-954732eb-4b2d-4b73-a51d-67a3d33b0b5c req-1b7279ba-c031-4220-a1a7-ce1ce137c603 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance with vm_state building and task_state spawning.
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:33 user nova-compute[71269]: INFO nova.compute.manager [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Terminating instance
Apr 13 23:04:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:34 user nova-compute[71269]: WARNING nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b for instance with vm_state building and task_state spawning.
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-changed-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Refreshing instance network info cache due to event network-changed-e6bb2fdf-5afa-4160-b657-34c1bafa0b23. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquiring lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquired lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Refreshing network info cache for port e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:34 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Instance destroyed successfully.
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid 06ecf305-65ca-4752-984c-cb7094593493 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2073414277',display_name='tempest-TestVolumeBootPattern-server-2073414277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2073414277',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-0h9sjdme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:02:50Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=06ecf305-65ca-4752-984c-cb7094593493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_vif [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6bb2fdf-5a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:04:34 user nova-compute[71269]: INFO os_vif [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6bb2fdf-5afa-4160-b657-34c1bafa0b23,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6bb2fdf-5a')
Apr 13 23:04:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:34 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c327ecd8-4a17-4be2-b455-81e74b99beb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:04:34 user nova-compute[71269]: No targets found.
Apr 13 23:04:34 user nova-compute[71269]: iSNS:
Apr 13 23:04:34 user nova-compute[71269]: No targets found.
Apr 13 23:04:34 user nova-compute[71269]: STATIC:
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:04:34 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:04:34 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:04:34 user nova-compute[71269]: FIRMWARE:
Apr 13 23:04:34 user nova-compute[71269]: No targets found.
Apr 13 23:04:34 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:04:34 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:04:34 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495ad3f-d3c4-4221-8a9b-6f91320b0966]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02f5c9-09a7-426e-acfd-44422e4c4839]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:34 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc7d1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a8e50-a997-4a0f-b8af-49814404478c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1cd13b-833a-4291-aab0-4858189331fd]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe6bd4-519a-435a-b0a6-007d742449cb]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3864d-830e-4fed-ab53-615341b5dc65]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26364323934333234', '/dev/disk/by-id/scsi-1SCST_BIOfe1af41f-cd2943242f29215b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe1af41f') {{(pid=81834) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 23:04:34 user nova-compute[71269]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26364323934333234
Apr 13 23:04:34 user nova-compute[71269]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOfe1af41f-cd2943242f29215b
Apr 13 23:04:34 user nova-compute[71269]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_fe1af41f
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96598ba7-ed0c-41ef-80ce-917b05e8f702]: (4, None) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91fd5b4-c9db-45ca-92e2-1a5810b7ac76]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054bf8b-c61f-4572-b6b9-5ce33c6b5234]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]
Apr 13 23:04:35 user nova-compute[71269]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.
Apr 13 23:04:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[db73f8ba-f5c5-46fb-a0d5-ed5ffe856051]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (375ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Deleting instance files /opt/stack/data/nova/instances/06ecf305-65ca-4752-984c-cb7094593493_del
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Deletion of /opt/stack/data/nova/instances/06ecf305-65ca-4752-984c-cb7094593493_del complete
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updated VIF entry in instance network info cache for port e6bb2fdf-5afa-4160-b657-34c1bafa0b23. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updating instance_info_cache with network_info: [{"id": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "address": "fa:16:3e:4a:77:f6", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6bb2fdf-5a", "ovs_interfaceid": "e6bb2fdf-5afa-4160-b657-34c1bafa0b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Releasing lock "refresh_cache-06ecf305-65ca-4752-984c-cb7094593493" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-unplugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] No waiting events found dispatching network-vif-unplugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-unplugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Acquiring lock "06ecf305-65ca-4752-984c-cb7094593493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] Lock "06ecf305-65ca-4752-984c-cb7094593493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] No waiting events found dispatching network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:35 user nova-compute[71269]: WARNING nova.compute.manager [req-f7ba8b62-0bd9-45f9-8eaa-828ee74bd3fd req-debeddbb-7509-4e1d-a735-784419238d25 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received unexpected event network-vif-plugged-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 for instance with vm_state active and task_state deleting.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance with vm_state building and task_state spawning.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:35 user nova-compute[71269]: WARNING nova.compute.manager [req-6c5885db-34bc-4b11-9ac1-c6cb67f21656 req-b372339c-1b5b-4a19-b91f-618a20d4727c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance with vm_state building and task_state spawning.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427075.561005, 10290935-3f12-4e11-9495-f9c037e89875 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] VM Resumed (Lifecycle Event)
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance spawned successfully.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427075.5625956, 10290935-3f12-4e11-9495-f9c037e89875 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] VM Started (Lifecycle Event)
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Took 11.40 seconds to spawn the instance on the hypervisor.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:35 user nova-compute[71269]: WARNING nova.compute.manager [req-7df751d8-1929-46c0-8f14-371bb5a5fa37 req-938e7863-4136-4e65-b67b-7748afb05a48 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance with vm_state building and task_state spawning.
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Took 27.61 seconds to build instance.
Apr 13 23:04:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2c6e75c1-8e6d-498f-aa22-c573d5e6e2ce tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.715s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:35 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:35 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Took 0.88 seconds to deallocate network for instance.
Apr 13 23:04:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-a23f5bbb-2bbe-480d-8c33-23e88cb2635b req-61d10d1e-6ab9-490c-81e8-94ae1e486d08 service nova] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Received event network-vif-deleted-e6bb2fdf-5afa-4160-b657-34c1bafa0b23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:36 user nova-compute[71269]: INFO nova.compute.manager [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 23:04:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:04:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.619s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:37 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance 06ecf305-65ca-4752-984c-cb7094593493
Apr 13 23:04:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6f597fc6-5319-420e-8b4b-29fced193f9d tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "06ecf305-65ca-4752-984c-cb7094593493" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.713s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:38 user nova-compute[71269]: INFO nova.compute.manager [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Attaching volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa to /dev/vdb
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.utils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e4f40a-fc28-47d2-9c2a-42279229cce7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7706e2-e095-49de-9b9d-fcfece002dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70917a4d-a56b-41d6-9d54-90424202b3f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f297d7-cbac-4e8e-9cff-b9b3abf35ea8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:04:39 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:04:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c823b59e-fa85-4b7b-8371-ceda0cfa2ce1]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG os_brick.utils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating existing volume attachment record: 1462b64b-c507-4286-bf9e-93da4a720254 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:04:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBdTvtrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:04:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:04:43 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa09cfd4-a967-44b2-80bd-3b8fc1669b27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:04:43 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc008e82-0947-40c4-a457-2605a3763754]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa] added
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa45c6-cee3-4346-9334-d7739e5f5a87]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9201a-e165-495b-a228-fc501956d919]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBdTvtrk {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBdTvtrk" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3ba98-139a-4604-82a9-0e6fde32f917]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBdTvtrk'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ec7d5-efa3-4ebc-8486-da2d107734e2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280ecbf-f202-4650-a87f-396f89d249c8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43be65-5f3e-4f10-a01d-e8f859c46dc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260]
Apr 13 23:04:43 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260] successful.
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[224bb2f5-81d8-4a4a-82bc-83a7043555bf]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f04416-f5fa-4520-8bce-71b85f40e77f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:04:43 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:04:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a61f9-9eac-4a71-a666-e568807441dc]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:04:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBdTvtrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26164616638663337', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164616638663337', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:04:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:04:44 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:04:44 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:04:44 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:04:44 user nova-compute[71269]:   <serial>2ac485a1-6354-4559-bc5d-5a22d6dfc7aa</serial>
Apr 13 23:04:44 user nova-compute[71269]: </disk>
Apr 13 23:04:44 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:04:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:04:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:04:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] No VIF found with MAC fa:16:3e:00:78:c3, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:04:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d139d38-7727-436b-b8ad-d4cd923ac915 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.425s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing instance network info cache due to event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG nova.network.neutron [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:49 user nova-compute[71269]: DEBUG nova.network.neutron [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updated VIF entry in instance network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:04:49 user nova-compute[71269]: DEBUG nova.network.neutron [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89c371de-de53-4472-b3ec-5650cc660901 req-4d3889f3-84df-49f7-a37f-7fac818f7b38 service nova] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:49 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427074.6157465, 06ecf305-65ca-4752-984c-cb7094593493 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:49 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 06ecf305-65ca-4752-984c-cb7094593493] VM Stopped (Lifecycle Event)
Apr 13 23:04:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-608b02f2-89d1-4b48-8233-b697c7b1bf11 None None] [instance: 06ecf305-65ca-4752-984c-cb7094593493] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:50 user nova-compute[71269]: DEBUG nova.compute.manager [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing instance network info cache due to event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:04:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:50 user nova-compute[71269]: DEBUG nova.network.neutron [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.network.neutron [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updated VIF entry in instance network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.network.neutron [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4e2c22ab-9337-480a-a130-2112cb36688a req-dd837f82-2961-41b3-abf4-38dd98705e9b service nova] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:51 user nova-compute[71269]: INFO nova.compute.manager [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Rebooting instance
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:54 user nova-compute[71269]: WARNING nova.compute.manager [req-c3558d70-82ad-4212-a431-26a0f848522f req-3857a6bd-b786-40b5-ab38-4e048e62010d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state active and task_state reboot_started.
Apr 13 23:04:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:04:55 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:55 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=26.205795288085938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance shutdown successfully.
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 10290935-3f12-4e11-9495-f9c037e89875 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:04:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:56 user nova-compute[71269]: WARNING nova.compute.manager [req-8fc9c0cc-d0dc-41f0-a62a-9a843a3ddc73 req-f900eced-502c-481a-8460-b72356e4469f service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state active and task_state reboot_started.
Apr 13 23:04:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:58 user nova-compute[71269]: WARNING nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state active and task_state reboot_started.
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:04:58 user nova-compute[71269]: WARNING nova.compute.manager [req-b519b9bb-42a6-4dbe-b7d1-df5e454808c1 req-1fcfe0f6-ec79-4655-b8e7-f5c37d5a50d8 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state active and task_state reboot_started.
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427098.9423306, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:58 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] VM Resumed (Lifecycle Event)
Apr 13 23:04:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance running successfully.
Apr 13 23:04:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance soft rebooted successfully.
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:58 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 23:04:58 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427098.9433448, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:04:58 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] VM Started (Lifecycle Event)
Apr 13 23:04:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:04:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aa2c9a72-2505-4ca2-9fc3-d371cd06cc7b tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.548s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:04:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:04:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:05:04 user nova-compute[71269]: INFO nova.compute.claims [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Claim successful on node user
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:05:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.policy [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:05:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Creating image(s)
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk 1073741824" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Successfully created port: d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Cannot resize image /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'migration_context' on Instance uuid 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Ensure instance console log exists: /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Successfully updated port: d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-changed-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Refreshing instance network info cache due to event network-changed-d8177896-73ec-435e-8d3d-b468a1bf47a4. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Acquiring lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updating instance_info_cache with network_info: [{"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Instance network_info: |[{"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Acquired lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Refreshing network info cache for port d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Start _get_guest_xml network_info=[{"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:05:06 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:06 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1404772141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1404772141',id=30,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-0iplzc78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:05:05Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=2d3ba9dd-fe6a-4d41-baab-9683ce65eb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.objects.instance [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:05:06 user nova-compute[71269]:   <uuid>2d3ba9dd-fe6a-4d41-baab-9683ce65eb57</uuid>
Apr 13 23:05:06 user nova-compute[71269]:   <name>instance-0000001e</name>
Apr 13 23:05:06 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:05:06 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:05:06 user nova-compute[71269]:   <metadata>
Apr 13 23:05:06 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:05:06 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1404772141</nova:name>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:05:06</nova:creationTime>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:05:06 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:05:06 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:owner>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 23:05:06 user nova-compute[71269]:       </nova:owner>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:05:06 user nova-compute[71269]:       <nova:ports>
Apr 13 23:05:06 user nova-compute[71269]:         <nova:port uuid="d8177896-73ec-435e-8d3d-b468a1bf47a4">
Apr 13 23:05:06 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:05:06 user nova-compute[71269]:         </nova:port>
Apr 13 23:05:06 user nova-compute[71269]:       </nova:ports>
Apr 13 23:05:06 user nova-compute[71269]:     </nova:instance>
Apr 13 23:05:06 user nova-compute[71269]:   </metadata>
Apr 13 23:05:06 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:05:06 user nova-compute[71269]:     <system>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="serial">2d3ba9dd-fe6a-4d41-baab-9683ce65eb57</entry>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="uuid">2d3ba9dd-fe6a-4d41-baab-9683ce65eb57</entry>
Apr 13 23:05:06 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:05:06 user nova-compute[71269]:     </system>
Apr 13 23:05:06 user nova-compute[71269]:   </sysinfo>
Apr 13 23:05:06 user nova-compute[71269]:   <os>
Apr 13 23:05:06 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:05:06 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:05:06 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:05:06 user nova-compute[71269]:   </os>
Apr 13 23:05:06 user nova-compute[71269]:   <features>
Apr 13 23:05:06 user nova-compute[71269]:     <acpi/>
Apr 13 23:05:06 user nova-compute[71269]:     <apic/>
Apr 13 23:05:06 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:05:06 user nova-compute[71269]:   </features>
Apr 13 23:05:06 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:05:06 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:05:06 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:05:06 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:05:06 user nova-compute[71269]:   </clock>
Apr 13 23:05:06 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:05:06 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:05:06 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:05:06 user nova-compute[71269]:   </cpu>
Apr 13 23:05:06 user nova-compute[71269]:   <devices>
Apr 13 23:05:06 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:05:06 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:05:06 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk"/>
Apr 13 23:05:06 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:05:06 user nova-compute[71269]:     </disk>
Apr 13 23:05:06 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:05:06 user nova-compute[71269]:       <mac address="fa:16:3e:82:14:cb"/>
Apr 13 23:05:06 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:05:06 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:05:06 user nova-compute[71269]:       <target dev="tapd8177896-73"/>
Apr 13 23:05:06 user nova-compute[71269]:     </interface>
Apr 13 23:05:06 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:05:06 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/console.log" append="off"/>
Apr 13 23:05:06 user nova-compute[71269]:     </serial>
Apr 13 23:05:06 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:05:06 user nova-compute[71269]:     <video>
Apr 13 23:05:06 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:05:06 user nova-compute[71269]:     </video>
Apr 13 23:05:06 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:05:06 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:05:06 user nova-compute[71269]:     </rng>
Apr 13 23:05:06 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:05:06 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:05:06 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:05:06 user nova-compute[71269]:     </memballoon>
Apr 13 23:05:06 user nova-compute[71269]:   </devices>
Apr 13 23:05:06 user nova-compute[71269]: </domain>
Apr 13 23:05:06 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1404772141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1404772141',id=30,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-0iplzc78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:05:05Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=2d3ba9dd-fe6a-4d41-baab-9683ce65eb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG os_vif [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8177896-73, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8177896-73, col_values=(('external_ids', {'iface-id': 'd8177896-73ec-435e-8d3d-b468a1bf47a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:14:cb', 'vm-uuid': '2d3ba9dd-fe6a-4d41-baab-9683ce65eb57'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:06 user nova-compute[71269]: INFO os_vif [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73')
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:82:14:cb, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:05:07 user nova-compute[71269]: DEBUG nova.network.neutron [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updated VIF entry in instance network info cache for port d8177896-73ec-435e-8d3d-b468a1bf47a4. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:05:07 user nova-compute[71269]: DEBUG nova.network.neutron [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updating instance_info_cache with network_info: [{"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e21a9a50-467d-4e43-86c3-e200d3f8623a req-6045d971-3221-42d7-8344-57a10e83c605 service nova] Releasing lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] No waiting events found dispatching network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:08 user nova-compute[71269]: WARNING nova.compute.manager [req-294aee37-4524-418a-9fe1-8f1ae05e3908 req-54369586-0a58-4bbb-a9a3-66380606ee4c service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received unexpected event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance with vm_state building and task_state spawning.
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427110.415626, 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] VM Resumed (Lifecycle Event)
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Instance spawned successfully.
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427110.4180322, 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] VM Started (Lifecycle Event)
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] No waiting events found dispatching network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:10 user nova-compute[71269]: WARNING nova.compute.manager [req-3162b155-e0d8-41b3-9641-9dacb2f7d072 req-6e16cf48-8939-40f0-aabc-448128fbdbd7 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received unexpected event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance with vm_state building and task_state spawning.
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-changed-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Refreshing instance network info cache due to event network-changed-b8721edc-dc82-4768-a1ae-894b8561f8a8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Acquiring lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Acquired lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Refreshing network info cache for port b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:05:10 user nova-compute[71269]: INFO nova.compute.manager [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Took 6.58 seconds to build instance.
Apr 13 23:05:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-fdedffcc-d0a9-48c8-a9cc-48f6cfa80d87 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.699s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updated VIF entry in instance network info cache for port b8721edc-dc82-4768-a1ae-894b8561f8a8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:05:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating instance_info_cache with network_info: [{"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-01b3eea7-e896-41fc-b270-52cbc9fb1373 req-d50367de-3116-43f7-bcbb-b48f26df1c02 service nova] Releasing lock "refresh_cache-381385a1-4c41-4479-b5cc-0222c9a7c2aa" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:13 user nova-compute[71269]: INFO nova.compute.manager [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attaching volume 6b000e14-0fd0-44bf-ad10-feeb6aa2f187 to /dev/vdb
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.utils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e3c91-7422-4993-aaee-f8395ac9c94b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d99ee7-4be4-4a2c-ad3e-c9aa0f89cbed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784d153-ed2e-4538-ba8d-80afcc4febf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7093916-ee7a-4e5d-bd3a-6a476b86127b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:13 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:05:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e304733-fde6-4053-ae1c-b493a5612be5]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG os_brick.utils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating existing volume attachment record: 5f3f32a1-b6e5-4e57-84d8-9366b335e267 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:05:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-changed-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Refreshing instance network info cache due to event network-changed-4eef61bd-3529-4ab4-9f58-881fac9cc1d6. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:05:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Acquiring lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Acquired lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Refreshing network info cache for port 4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:05:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updated VIF entry in instance network info cache for port 4eef61bd-3529-4ab4-9f58-881fac9cc1d6. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:05:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating instance_info_cache with network_info: [{"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f9dfd7a9-c1d9-40fe-8c17-2b78834908f7 req-ece5a148-b575-4f52-a8ff-13c1976f0d4a service nova] Releasing lock "refresh_cache-454fafc9-4b6f-40c3-80fa-d590fb946889" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:17 user nova-compute[71269]: INFO nova.compute.manager [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Attaching volume 4a555bb1-72bd-44b8-8488-74f2095b1353 to /dev/vdb
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.utils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e4b65-5391-4880-955d-f5f426a8a946]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b7130d-d08b-4cfd-b3af-f30571e71b95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931f244-c660-4ea3-a037-dcc49efd407e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[774608db-8f24-44a9-85fd-6c6e9da1a3c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:17 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:05:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f3a09-ac40-42b4-b65d-827c96b99cee]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG os_brick.utils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:17 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating existing volume attachment record: 04509b4e-d413-40c5-9816-f2558bdccee4 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdCmgZez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:18 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:18 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:18 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[080da92c-8a87-459f-9400-1d7f8a5ca474]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:05:18 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d443a-b779-4091-b3b6-2e0e7027da10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187] added
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edb149-5fac-433a-809c-fb7abc269f47]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[647984fd-bc8e-4b23-a3e8-94146ce5ad20]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdCmgZez {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdCmgZez" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[09979277-6559-4655-b824-bc80df0dc88d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdCmgZez'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d637be5c-d6cc-4ae6-84e6-5688af774128]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c60ba1-e3a8-44af-a6cd-e46af3242dfa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[93182370-5405-4de6-9dc6-8164446b05e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260]
Apr 13 23:05:18 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d3f07-6711-4ab2-b29f-57f1adee2a9f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c5882-e750-4565-983b-ca40b4f57807]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:18 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b9737-7ef0-4e6b-8683-8445b8ee341a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdCmgZez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23966383439356637', 'path': '/dev/sdh'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966383439356637', 'path': '/dev/sdh'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:05:19 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:19 user nova-compute[71269]:   <source dev="/dev/sdh"/>
Apr 13 23:05:19 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:19 user nova-compute[71269]:   <serial>6b000e14-0fd0-44bf-ad10-feeb6aa2f187</serial>
Apr 13 23:05:19 user nova-compute[71269]: </disk>
Apr 13 23:05:19 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:05:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No VIF found with MAC fa:16:3e:0a:4d:0a, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:05:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0efc924a-aa5f-47f9-a621-cc02fc4dfe97 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.866s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yegaVQGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:22 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:22 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:22 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e508ce-0aef-478d-82a3-de4e263255ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:05:22 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f32cb9-058e-4833-a62f-d5a68ea3a52e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353] added
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0928b3-1172-491d-be2a-dcddab012d7d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6ba4b-2f8a-43ef-8371-107d5cd9e16b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yegaVQGF {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yegaVQGF" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc5092-283e-4731-bacf-b68abeb81b31]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yegaVQGF'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b8bdda-742c-4ab0-a2b2-d9426119afce]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1af56f7-3e85-4371-9faf-5732feab80f2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: INFO nova.compute.manager [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Unrescuing
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[98807bf5-739b-4d21-88c3-f8aec985e539]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260]
Apr 13 23:05:22 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd850239-2c12-4117-b2d8-b780225f7096]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[379844ee-79a1-4c6d-9fed-29f1cfdedd03]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)
Apr 13 23:05:22 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] HCTL ('40', '-', '-', 0) found on session 31 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2f352-6492-4234-a846-98a61bb42e7e]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Searching for a device in session 31 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:22 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yegaVQGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:23 user nova-compute[71269]: WARNING nova.compute.manager [req-b1f123a9-7fe4-4933-b00b-8626bcfa061e req-ac0c50b4-a712-4bb8-82c4-e11118dc1885 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:05:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23564386363643835', 'path': '/dev/sdi'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564386363643835', 'path': '/dev/sdi'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance destroyed successfully.
Apr 13 23:05:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:05:23 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:23 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:23 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:23 user nova-compute[71269]:   <serial>4a555bb1-72bd-44b8-8488-74f2095b1353</serial>
Apr 13 23:05:23 user nova-compute[71269]: </disk>
Apr 13 23:05:23 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:23 user nova-compute[71269]: INFO nova.compute.manager [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attaching volume a4613e4b-c3e6-4a25-bc39-1a81569e6916 to /dev/vdc
Apr 13 23:05:23 user nova-compute[71269]: DEBUG os_brick.utils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[982b9922-9b41-42aa-8e0d-5c1e172d20bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76ee882-3e6d-4f4f-ba86-e5faac884af6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3edb2a-26f0-4aa5-9646-3488209e5b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e66790-2147-4a09-942f-5c4320ccdb2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:05:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:24 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:05:24 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[58633ecc-2b3f-482e-9fab-1c166263764f]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG os_brick.utils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating existing volume attachment record: 6d7a1c89-bafc-464e-a150-c395b4f4270f {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] No VIF found with MAC fa:16:3e:d3:ef:a2, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:05:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e95994be-9025-43c7-93f4-3045e0009075 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.045s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:25 user nova-compute[71269]: INFO nova.compute.manager [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Detaching volume 4a555bb1-72bd-44b8-8488-74f2095b1353
Apr 13 23:05:25 user nova-compute[71269]: INFO nova.virt.block_device [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Attempting to driver detach volume 4a555bb1-72bd-44b8-8488-74f2095b1353 from mountpoint /dev/vdb
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Attempting to detach device vdb from instance 454fafc9-4b6f-40c3-80fa-d590fb946889 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:25 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:25 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:25 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:25 user nova-compute[71269]:   <serial>4a555bb1-72bd-44b8-8488-74f2095b1353</serial>
Apr 13 23:05:25 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:05:25 user nova-compute[71269]: </disk>
Apr 13 23:05:25 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 454fafc9-4b6f-40c3-80fa-d590fb946889 from the persistent domain config.
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 454fafc9-4b6f-40c3-80fa-d590fb946889 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:25 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:25 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:25 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:25 user nova-compute[71269]:   <serial>4a555bb1-72bd-44b8-8488-74f2095b1353</serial>
Apr 13 23:05:25 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:05:25 user nova-compute[71269]: </disk>
Apr 13 23:05:25 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:05:25 user nova-compute[71269]: INFO nova.compute.claims [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Claim successful on node user
Apr 13 23:05:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:25 user nova-compute[71269]: WARNING nova.compute.manager [req-d8aa50c5-73e4-42a4-95fa-e1c2c065a707 req-3b1dc3f9-a853-44c4-a1aa-a653423ad844 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:05:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427126.1305046, 454fafc9-4b6f-40c3-80fa-d590fb946889 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:05:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully detached device vdb from instance 454fafc9-4b6f-40c3-80fa-d590fb946889 from the live domain config.
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yegaVQGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:26 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0ba59-c919-42f9-bcd4-bd73b9fa2572]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:05:26 user nova-compute[71269]: No targets found.
Apr 13 23:05:26 user nova-compute[71269]: iSNS:
Apr 13 23:05:26 user nova-compute[71269]: No targets found.
Apr 13 23:05:26 user nova-compute[71269]: STATIC:
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353
Apr 13 23:05:26 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:26 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:26 user nova-compute[71269]: FIRMWARE:
Apr 13 23:05:26 user nova-compute[71269]: No targets found.
Apr 13 23:05:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:05:26 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:05:26 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc5992e-deb6-4b3a-949f-e417b0f15f70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d223c-87af-4030-a4ca-4937b6fb70a7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 (non-flash)
Apr 13 23:05:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2b4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353'): ({'sdi'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Removing single pathed devices sdi {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb63f7-583d-4431-b280-93925587a46a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ddf8c-dd95-4536-bf3b-7590e5f19004]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Flushing IO for device /dev/sdi {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57009384-0ca7-488d-90f5-b6a6ce9cf8e5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: INFO nova.virt.block_device [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Booting with volume 7e14d684-74a4-43e0-aa03-5dc4d626d990 at /dev/vda
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802fe41-f305-4ee3-a776-ae74b44c1173]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] SCSI volumes sdi have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.policy [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea608d18-270c-45b1-a86a-4532d7d2ca52]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.utils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6f534-5f89-4d0c-893d-b652f7ed7e50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768635a-06da-4762-aab8-96a1ef234c0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57977ec0-6c45-4f90-abe0-5b997aef4a4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2527be-c9be-45b5-bac1-6cac7fc18cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d36484c-62e9-4406-84f1-91b2c41ffa3d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260]
Apr 13 23:05:26 user nova-compute[71269]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:26 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:05:26 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874b76f-4c6e-4b8b-b19b-5569f178894f]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.utils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating existing volume attachment record: 412f4de7-b498-49e2-9018-bdebacbaa6ac {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a555bb1-72bd-44b8-8488-74f2095b1353 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[340659a5-bc16-43a7-83b3-1a9decff213a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] <== disconnect_volume: return (442ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:05:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Successfully created port: a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'flavor' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:27 user nova-compute[71269]: WARNING nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:27 user nova-compute[71269]: WARNING nova.compute.manager [req-532ac334-c2dd-43ea-98ed-5ce37cca40f1 req-19b0340d-5560-4dba-931d-6e442798bca3 service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:05:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-55697d77-0be2-4a0d-b861-30408acfa3c9 tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.388s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for deb24b5e-f858-4068-88c5-3c7708c7e195 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427128.1125262, deb24b5e-f858-4068-88c5-3c7708c7e195 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:28 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Resumed (Lifecycle Event)
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e1348219-e957-47a0-8f27-ca5f0f706b5c tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:28 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427128.1129026, deb24b5e-f858-4068-88c5-3c7708c7e195 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:28 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Started (Lifecycle Event)
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Successfully updated port: a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing instance network info cache due to event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Acquiring lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating instance_info_cache with network_info: [{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Instance network_info: |[{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Acquired lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:05:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbWPSLzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:29 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:29 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:29 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2dbbad-72f6-4a1c-b96a-4a589acd3f5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:05:29 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe0b2f-7cdc-4633-b5a0-fa34c18766f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916] added
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7136b5e-7869-4d6c-aeae-b15388cfa68d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61781729-d923-49cf-a1b6-15a0650ac1e2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbWPSLzI {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updated VIF entry in instance network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating instance_info_cache with network_info: [{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbWPSLzI" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[786652be-852c-438a-b94c-cede208b1bea]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbWPSLzI'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c8e3d884-6547-448b-a2cf-ddde1170825a req-582ba519-2f82-4edf-94de-2af386fa4dc4 service nova] Releasing lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[826219e2-ec7a-4f0a-81df-c36b2c1a472a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acfde52-42d8-43a2-9a4b-c22d98a65286]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c907b2-be89-401a-8a0c-f75f92958215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260]
Apr 13 23:05:29 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dff336-cdcf-43cd-9670-44c3ece2cf3e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a373ff5e-3aa0-4d14-b119-2b0afb168b10]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:29 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] HCTL ('40', '-', '-', 0) found on session 32 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f9fd8-97ed-4393-8d01-458f6ed5d2b6]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:29 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 32 and hctl ['40', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Searching for a device in session 32 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbWPSLzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23062326261306637', 'path': '/dev/sdi'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062326261306637', 'path': '/dev/sdi'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:05:30 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:30 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:30 user nova-compute[71269]:   <target dev="vdc" bus="virtio"/>
Apr 13 23:05:30 user nova-compute[71269]:   <serial>a4613e4b-c3e6-4a25-bc39-1a81569e6916</serial>
Apr 13 23:05:30 user nova-compute[71269]: </disk>
Apr 13 23:05:30 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] No VIF found with MAC fa:16:3e:0a:4d:0a, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a6f12c16-942e-4334-86db-3df3f2811739 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:05:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Creating image(s)
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Ensure instance console log exists: /opt/stack/data/nova/instances/1a83b839-7b5b-4004-94da-d196d18caf0f/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Start _get_guest_xml network_info=[{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '412f4de7-b498-49e2-9018-bdebacbaa6ac', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a83b839-7b5b-4004-94da-d196d18caf0f', 'attached_at': '', 'detached_at': '', 'volume_id': '7e14d684-74a4-43e0-aa03-5dc4d626d990', 'serial': '7e14d684-74a4-43e0-aa03-5dc4d626d990'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:05:31 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:31 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:31 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:31 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:31 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc6ffc4-b51f-4bd5-bc2f-8cb460b94fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:05:31 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee10097a-ab89-400d-aad5-2a20c6a55add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990] added
Apr 13 23:05:31 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5931727a-18ec-42e5-b437-4b457654f948]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61dc27e-2509-43af-8e13-4a1c2b3068a6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgIkJYPK {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgIkJYPK" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347fa64-284a-407d-9d4a-023f69635204]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgIkJYPK'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb705b9-5faa-4eac-9eda-3404aa53f636]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c49e5-1bed-4489-89cc-4e646e0fe67b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:31 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5416380-d938-4ad6-9bc0-0f8171c58977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]
Apr 13 23:05:31 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:31 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:31 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b90ef6-842c-4c16-b4b1-7d53f548ce53]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db92835-94ea-4188-ab37-bc9a5aa5d328]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('41', '-', '-', 0) found on session 33 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2927c4-2be1-4412-8d01-36491e8ff638]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 33 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:32 user nova-compute[71269]: INFO nova.compute.manager [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Detaching volume 6b000e14-0fd0-44bf-ad10-feeb6aa2f187
Apr 13 23:05:32 user nova-compute[71269]: INFO nova.virt.block_device [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attempting to driver detach volume 6b000e14-0fd0-44bf-ad10-feeb6aa2f187 from mountpoint /dev/vdb
Apr 13 23:05:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Attempting to detach device vdb from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:32 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:32 user nova-compute[71269]:   <source dev="/dev/sdh"/>
Apr 13 23:05:32 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:32 user nova-compute[71269]:   <serial>6b000e14-0fd0-44bf-ad10-feeb6aa2f187</serial>
Apr 13 23:05:32 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:05:32 user nova-compute[71269]: </disk>
Apr 13 23:05:32 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdb from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the persistent domain config.
Apr 13 23:05:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:05:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:32 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:32 user nova-compute[71269]:   <source dev="/dev/sdh"/>
Apr 13 23:05:32 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:05:32 user nova-compute[71269]:   <serial>6b000e14-0fd0-44bf-ad10-feeb6aa2f187</serial>
Apr 13 23:05:32 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:05:32 user nova-compute[71269]: </disk>
Apr 13 23:05:32 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '26364323934333234', 'path': '/dev/sdj'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364323934333234', 'path': '/dev/sdj'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876646587',display_name='tempest-TestVolumeBootPattern-server-876646587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876646587',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-rmk6pnk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:05:26Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a83b839-7b5b-4004-94da-d196d18caf0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a83b839-7b5b-4004-94da-d196d18caf0f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:05:33 user nova-compute[71269]:   <uuid>1a83b839-7b5b-4004-94da-d196d18caf0f</uuid>
Apr 13 23:05:33 user nova-compute[71269]:   <name>instance-0000001f</name>
Apr 13 23:05:33 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:05:33 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:05:33 user nova-compute[71269]:   <metadata>
Apr 13 23:05:33 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:05:33 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:05:33 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-server-876646587</nova:name>
Apr 13 23:05:33 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:05:31</nova:creationTime>
Apr 13 23:05:33 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:05:33 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:05:33 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:05:33 user nova-compute[71269]:       <nova:owner>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 23:05:33 user nova-compute[71269]:       </nova:owner>
Apr 13 23:05:33 user nova-compute[71269]:       <nova:ports>
Apr 13 23:05:33 user nova-compute[71269]:         <nova:port uuid="a88bc4ee-b024-4d26-9e56-e60daf6ef5fa">
Apr 13 23:05:33 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 23:05:33 user nova-compute[71269]:         </nova:port>
Apr 13 23:05:33 user nova-compute[71269]:       </nova:ports>
Apr 13 23:05:33 user nova-compute[71269]:     </nova:instance>
Apr 13 23:05:33 user nova-compute[71269]:   </metadata>
Apr 13 23:05:33 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:05:33 user nova-compute[71269]:     <system>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="serial">1a83b839-7b5b-4004-94da-d196d18caf0f</entry>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="uuid">1a83b839-7b5b-4004-94da-d196d18caf0f</entry>
Apr 13 23:05:33 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:05:33 user nova-compute[71269]:     </system>
Apr 13 23:05:33 user nova-compute[71269]:   </sysinfo>
Apr 13 23:05:33 user nova-compute[71269]:   <os>
Apr 13 23:05:33 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:05:33 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:05:33 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:05:33 user nova-compute[71269]:   </os>
Apr 13 23:05:33 user nova-compute[71269]:   <features>
Apr 13 23:05:33 user nova-compute[71269]:     <acpi/>
Apr 13 23:05:33 user nova-compute[71269]:     <apic/>
Apr 13 23:05:33 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:05:33 user nova-compute[71269]:   </features>
Apr 13 23:05:33 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:05:33 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:05:33 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:05:33 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:05:33 user nova-compute[71269]:   </clock>
Apr 13 23:05:33 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:05:33 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:05:33 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:05:33 user nova-compute[71269]:   </cpu>
Apr 13 23:05:33 user nova-compute[71269]:   <devices>
Apr 13 23:05:33 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:05:33 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:33 user nova-compute[71269]:       <source dev="/dev/sdj"/>
Apr 13 23:05:33 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:05:33 user nova-compute[71269]:       <serial>7e14d684-74a4-43e0-aa03-5dc4d626d990</serial>
Apr 13 23:05:33 user nova-compute[71269]:     </disk>
Apr 13 23:05:33 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:05:33 user nova-compute[71269]:       <mac address="fa:16:3e:56:ea:3b"/>
Apr 13 23:05:33 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:05:33 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:05:33 user nova-compute[71269]:       <target dev="tapa88bc4ee-b0"/>
Apr 13 23:05:33 user nova-compute[71269]:     </interface>
Apr 13 23:05:33 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:05:33 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/1a83b839-7b5b-4004-94da-d196d18caf0f/console.log" append="off"/>
Apr 13 23:05:33 user nova-compute[71269]:     </serial>
Apr 13 23:05:33 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:05:33 user nova-compute[71269]:     <video>
Apr 13 23:05:33 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:05:33 user nova-compute[71269]:     </video>
Apr 13 23:05:33 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:05:33 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:05:33 user nova-compute[71269]:     </rng>
Apr 13 23:05:33 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:05:33 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:05:33 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:05:33 user nova-compute[71269]:     </memballoon>
Apr 13 23:05:33 user nova-compute[71269]:   </devices>
Apr 13 23:05:33 user nova-compute[71269]: </domain>
Apr 13 23:05:33 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876646587',display_name='tempest-TestVolumeBootPattern-server-876646587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876646587',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-rmk6pnk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:05:26Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a83b839-7b5b-4004-94da-d196d18caf0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_vif [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88bc4ee-b0, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa88bc4ee-b0, col_values=(('external_ids', {'iface-id': 'a88bc4ee-b024-4d26-9e56-e60daf6ef5fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ea:3b', 'vm-uuid': '1a83b839-7b5b-4004-94da-d196d18caf0f'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:33 user nova-compute[71269]: INFO os_vif [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0')
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:56:ea:3b, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427133.3980877, 381385a1-4c41-4479-b5cc-0222c9a7c2aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:05:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdb from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the live domain config.
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdCmgZez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:33 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb38e8a-6006-413a-9fed-533998785ac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:05:33 user nova-compute[71269]: No targets found.
Apr 13 23:05:33 user nova-compute[71269]: iSNS:
Apr 13 23:05:33 user nova-compute[71269]: No targets found.
Apr 13 23:05:33 user nova-compute[71269]: STATIC:
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916
Apr 13 23:05:33 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:33 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:33 user nova-compute[71269]: FIRMWARE:
Apr 13 23:05:33 user nova-compute[71269]: No targets found.
Apr 13 23:05:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:05:33 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:05:33 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb508e-864b-4cb0-8b11-017e1ea752b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[24deef2b-0175-4eb1-9abc-2383fb755911]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb31cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187'): ({'sdh'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Removing single pathed devices sdh {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7e962-e92a-47e9-9e89-46c334c90b77]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baa62b7-3811-4451-907f-92bdc25ebf51]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flushing IO for device /dev/sdh {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735bf32-24d9-400a-b265-b306a5937d6d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9603a826-0284-45f2-9c13-85a5eaae3de2]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] SCSI volumes sdh have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f1e775-7aae-4848-a2b2-ff395d54b183]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e8215-309b-4872-9b10-954fe5d1b433]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260]
Apr 13 23:05:33 user nova-compute[71269]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b000e14-0fd0-44bf-ad10-feeb6aa2f187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c88bad8-f58d-4d2d-9372-26d6e32776b4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== disconnect_volume: return (381ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:05:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5a26b7f2-f309-4785-8ee6-186a34ff7e8c tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.929s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:35 user nova-compute[71269]: WARNING nova.compute.manager [req-04ad1038-829c-4c68-9737-e34cd07391f4 req-5023f9b0-8775-4559-b40c-b25f3b0e1b3c service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state building and task_state spawning.
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:35 user nova-compute[71269]: INFO nova.compute.manager [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Detaching volume a4613e4b-c3e6-4a25-bc39-1a81569e6916
Apr 13 23:05:35 user nova-compute[71269]: INFO nova.virt.block_device [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Attempting to driver detach volume a4613e4b-c3e6-4a25-bc39-1a81569e6916 from mountpoint /dev/vdc
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Attempting to detach device vdc from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:35 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:35 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:35 user nova-compute[71269]:   <target dev="vdc" bus="virtio"/>
Apr 13 23:05:35 user nova-compute[71269]:   <serial>a4613e4b-c3e6-4a25-bc39-1a81569e6916</serial>
Apr 13 23:05:35 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 23:05:35 user nova-compute[71269]: </disk>
Apr 13 23:05:35 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdc from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the persistent domain config.
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:05:35 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:05:35 user nova-compute[71269]:   <source dev="/dev/sdi"/>
Apr 13 23:05:35 user nova-compute[71269]:   <target dev="vdc" bus="virtio"/>
Apr 13 23:05:35 user nova-compute[71269]:   <serial>a4613e4b-c3e6-4a25-bc39-1a81569e6916</serial>
Apr 13 23:05:35 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 23:05:35 user nova-compute[71269]: </disk>
Apr 13 23:05:35 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427135.7980957, 381385a1-4c41-4479-b5cc-0222c9a7c2aa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:05:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully detached device vdc from instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa from the live domain config.
Apr 13 23:05:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbWPSLzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:05:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8103d-1d68-4404-83c6-e23e04b9b49e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:05:35 user nova-compute[71269]: No targets found.
Apr 13 23:05:35 user nova-compute[71269]: iSNS:
Apr 13 23:05:35 user nova-compute[71269]: No targets found.
Apr 13 23:05:35 user nova-compute[71269]: STATIC:
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916
Apr 13 23:05:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:05:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:05:35 user nova-compute[71269]: FIRMWARE:
Apr 13 23:05:35 user nova-compute[71269]: No targets found.
Apr 13 23:05:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:05:35 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:05:35 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecf0ba-b69e-4199-8e3f-a82d87575902]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b9652b-130b-4601-a55c-6e3ab54eff05]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:05:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc7bb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916'): ({'sdi'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Removing single pathed devices sdi {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5acee54-6e6e-4492-8b7c-7d88e04ffcd5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6fe15-458e-42e6-a42d-e3c229defbde]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Flushing IO for device /dev/sdi {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1930ef4-8ea6-400d-ac2e-2957717c4749]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:05:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e2565-a7dc-4365-abca-33b028f24d01]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] SCSI volumes sdi have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb4aa4b-8623-4985-b920-5800100b2bf6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e21cbc-b9c0-40ea-a9f0-6d59e4f68418]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260]
Apr 13 23:05:36 user nova-compute[71269]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916, portal: 172.16.0.220,3260] successful.
Apr 13 23:05:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4613e4b-c3e6-4a25-bc39-1a81569e6916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f12c6e-5be5-4726-a650-5352ab0d8890]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] <== disconnect_volume: return (368ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'flavor' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-33934f1e-e772-48e0-9bf1-18b363ff1388 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.749s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:37 user nova-compute[71269]: WARNING nova.compute.manager [req-fab4aff3-4407-4e32-a28a-c5a8c208ef5b req-0bfa5133-219c-4ea3-b614-918646e52b22 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state building and task_state spawning.
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427137.0953891, 1a83b839-7b5b-4004-94da-d196d18caf0f => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] VM Resumed (Lifecycle Event)
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Instance spawned successfully.
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427137.0977643, 1a83b839-7b5b-4004-94da-d196d18caf0f => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] VM Started (Lifecycle Event)
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Took 11.75 seconds to build instance.
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0bfc3805-481a-422b-ac80-644cc9fc59d8 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.857s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:37 user nova-compute[71269]: INFO nova.compute.manager [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Terminating instance
Apr 13 23:05:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-unplugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] No waiting events found dispatching network-vif-unplugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ca3d784-c11c-440a-9be0-5dc25159f7ea req-a9587ae8-c55e-4644-a931-3ceb0bd832a0 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-unplugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Instance destroyed successfully.
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lazy-loading 'resources' on Instance uuid 381385a1-4c41-4479-b5cc-0222c9a7c2aa {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1360471313',display_name='tempest-AttachVolumeTestJSON-server-1360471313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1360471313',id=26,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfUWVI8IOPtgGPQLd2ogb+LB+C/kCsbiJob8LDBPVAPjT7tXncvXjQQwIlebgqjND7LJaONDLwpT9nVZvik8n9ZW1Lw+oRM7rk6w4HCK0B0/C97upBdLDNGJcWvMc8+RA==',key_name='tempest-keypair-229071683',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0648ea953174a8cae6085ac24d92bb1',ramdisk_id='',reservation_id='r-ldtw84zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-118072319',owner_user_name='tempest-AttachVolumeTestJSON-118072319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13b46af525dd45678b69207e93683ac4',uuid=381385a1-4c41-4479-b5cc-0222c9a7c2aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converting VIF {"id": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "address": "fa:16:3e:0a:4d:0a", "network": {"id": "a708f18b-3eef-4221-bc1b-e4c90b6c6af8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-610488141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0648ea953174a8cae6085ac24d92bb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8721edc-dc", "ovs_interfaceid": "b8721edc-dc82-4768-a1ae-894b8561f8a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG os_vif [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8721edc-dc, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:05:38 user nova-compute[71269]: INFO os_vif [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4d:0a,bridge_name='br-int',has_traffic_filtering=True,id=b8721edc-dc82-4768-a1ae-894b8561f8a8,network=Network(a708f18b-3eef-4221-bc1b-e4c90b6c6af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8721edc-dc')
Apr 13 23:05:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Deleting instance files /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa_del
Apr 13 23:05:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Deletion of /opt/stack/data/nova/instances/381385a1-4c41-4479-b5cc-0222c9a7c2aa_del complete
Apr 13 23:05:38 user nova-compute[71269]: INFO nova.compute.manager [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 23:05:38 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:05:38 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:05:39 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:39 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Took 0.85 seconds to deallocate network for instance.
Apr 13 23:05:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-deleted-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:39 user nova-compute[71269]: INFO nova.compute.manager [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Neutron deleted interface b8721edc-dc82-4768-a1ae-894b8561f8a8; detaching it from the instance and deleting it from the info cache
Apr 13 23:05:39 user nova-compute[71269]: DEBUG nova.network.neutron [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-057f771f-2895-4a4c-aba6-c15ef0c8997c req-9875184e-7c6a-4092-a7c4-44a6525a42b5 service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Detach interface failed, port_id=b8721edc-dc82-4768-a1ae-894b8561f8a8, reason: Instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:05:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:40 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Deleted allocations for instance 381385a1-4c41-4479-b5cc-0222c9a7c2aa
Apr 13 23:05:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1419e00-3848-49b0-84d2-1fd478c29080 tempest-AttachVolumeTestJSON-118072319 tempest-AttachVolumeTestJSON-118072319-project-member] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Acquiring lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] Lock "381385a1-4c41-4479-b5cc-0222c9a7c2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] No waiting events found dispatching network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:40 user nova-compute[71269]: WARNING nova.compute.manager [req-70acae1d-91a8-429e-bb60-8b67ab648ef6 req-7a4da5fe-5403-48ed-a3e0-5ca1bf72e47b service nova] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Received unexpected event network-vif-plugged-b8721edc-dc82-4768-a1ae-894b8561f8a8 for instance with vm_state deleted and task_state None.
Apr 13 23:05:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:51 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:52 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427138.715542, 381385a1-4c41-4479-b5cc-0222c9a7c2aa => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:05:53 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] VM Stopped (Lifecycle Event)
Apr 13 23:05:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-602c762b-bde6-4b55-b462-45b853747b17 None None] [instance: 381385a1-4c41-4479-b5cc-0222c9a7c2aa] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:55 user nova-compute[71269]: INFO nova.compute.manager [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Terminating instance
Apr 13 23:05:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-unplugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] No waiting events found dispatching network-vif-unplugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-f4e46257-82a3-4982-818a-f1d5d570c5f3 req-055b8c17-f7e0-4372-9737-73aa33c06172 service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-unplugged-6ab4b160-3952-4332-9443-7f743c5feb6c for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:05:56 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Instance destroyed successfully.
Apr 13 23:05:56 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:56 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=26.21847152709961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'resources' on Instance uuid 47dce1cc-c872-41f3-81af-acfc6ccabe18 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1989795804',display_name='tempest-ServersNegativeTestJSON-server-1989795804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1989795804',id=28,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-phokkcsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:13Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=47dce1cc-c872-41f3-81af-acfc6ccabe18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "6ab4b160-3952-4332-9443-7f743c5feb6c", "address": "fa:16:3e:36:9c:71", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ab4b160-39", "ovs_interfaceid": "6ab4b160-3952-4332-9443-7f743c5feb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG os_vif [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ab4b160-39, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:05:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:57 user nova-compute[71269]: INFO os_vif [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9c:71,bridge_name='br-int',has_traffic_filtering=True,id=6ab4b160-3952-4332-9443-7f743c5feb6c,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ab4b160-39')
Apr 13 23:05:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Deleting instance files /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18_del
Apr 13 23:05:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Deletion of /opt/stack/data/nova/instances/47dce1cc-c872-41f3-81af-acfc6ccabe18_del complete
Apr 13 23:05:57 user nova-compute[71269]: INFO nova.compute.manager [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Took 1.09 seconds to destroy the instance on the hypervisor.
Apr 13 23:05:57 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 10290935-3f12-4e11-9495-f9c037e89875 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a83b839-7b5b-4004-94da-d196d18caf0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:57 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Took 0.49 seconds to deallocate network for instance.
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-deleted-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:57 user nova-compute[71269]: INFO nova.compute.manager [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Neutron deleted interface 6ab4b160-3952-4332-9443-7f743c5feb6c; detaching it from the instance and deleting it from the info cache
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.network.neutron [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.manager [req-b5e25d1e-23ac-46e4-94b6-ea0234ae0c68 req-8decb261-f6e8-4486-9c24-e037cfcc004f service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Detach interface failed, port_id=6ab4b160-3952-4332-9443-7f743c5feb6c, reason: Instance 47dce1cc-c872-41f3-81af-acfc6ccabe18 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:05:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:58 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Deleted allocations for instance 47dce1cc-c872-41f3-81af-acfc6ccabe18
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f2698296-f247-4340-9e55-bb97b4413e90 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Acquiring lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] Lock "47dce1cc-c872-41f3-81af-acfc6ccabe18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] No waiting events found dispatching network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:05:58 user nova-compute[71269]: WARNING nova.compute.manager [req-4dfb2831-7f37-4bf2-94ff-f36040c1a5c2 req-6f942056-eb24-431c-8e09-12c327e0860c service nova] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Received unexpected event network-vif-plugged-6ab4b160-3952-4332-9443-7f743c5feb6c for instance with vm_state deleted and task_state None.
Apr 13 23:05:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-changed-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing instance network info cache due to event network-changed-03889253-8210-430d-b5a9-47d58c066803. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Acquiring lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Acquired lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:05:58 user nova-compute[71269]: DEBUG nova.network.neutron [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Refreshing network info cache for port 03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updated VIF entry in instance network info cache for port 03889253-8210-430d-b5a9-47d58c066803. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG nova.network.neutron [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9447326b-2589-4b9c-889b-e8c7805b1a4e req-c5309e8b-3cbc-4ba5-ba71-daa0f8cccb8c service nova] Releasing lock "refresh_cache-10290935-3f12-4e11-9495-f9c037e89875" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:05:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:00 user nova-compute[71269]: INFO nova.compute.manager [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Terminating instance
Apr 13 23:06:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-ace390fb-c02c-4a6d-8b11-e66e035aa457 req-5aac1861-401d-4e11-b42e-e7922a869d30 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-03889253-8210-430d-b5a9-47d58c066803 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-f18feb95-3bfd-4399-b842-36b63cb46922 req-0864a41b-d5e0-4788-9778-88e08b5fd73d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-4013cb2d-9c90-462c-9cce-50853dcb225c req-4cc4f527-4372-408c-8d49-080791d6f0db service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-56cd2acf-5e6d-4703-a160-2cf983399d6b for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Instance destroyed successfully.
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lazy-loading 'resources' on Instance uuid 10290935-3f12-4e11-9495-f9c037e89875 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03889253-82, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:8d:fc,bridge_name='br-int',has_traffic_filtering=True,id=03889253-8210-430d-b5a9-47d58c066803,network=Network(d1c8df15-f9c6-4610-9aa6-ada35fdc3f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03889253-82')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77b2db4a-b1, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:34:31,bridge_name='br-int',has_traffic_filtering=True,id=77b2db4a-b1bb-4628-a21a-1e24199cf117,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77b2db4a-b1')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec62d21a-ca, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2f:fb,bridge_name='br-int',has_traffic_filtering=True,id=ec62d21a-cab5-4c13-85df-0e7134cc11d3,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec62d21a-ca')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56cd2acf-5e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:a9,bridge_name='br-int',has_traffic_filtering=True,id=56cd2acf-5e6d-4703-a160-2cf983399d6b,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cd2acf-5e')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6a692ff-98, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:89:14,bridge_name='br-int',has_traffic_filtering=True,id=d6a692ff-983e-4d9b-abb2-45fee280cb60,network=Network(9e024860-32be-4c74-b371-c7a8b93537c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a692ff-98')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "address": "fa:16:3e:87:98:15", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad651a01-eb", "ovs_interfaceid": "ad651a01-eb81-4baf-8b6c-ff196a729d67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad651a01-eb, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:98:15,bridge_name='br-int',has_traffic_filtering=True,id=ad651a01-eb81-4baf-8b6c-ff196a729d67,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad651a01-eb')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T23:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-747263411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-747263411',id=29,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaoXcF4y/zDce3/XJOvuFUZ+icKWYCjxc/Ofy9WPwjzRjyHNypyBhlnzJDV2zFCgWTYnwzhYwY1y4vejBmyOxRrFMttK5In08XN+nq9aoQ2jMQ0AIc7NJ1/U2f6+wotw==',key_name='tempest-keypair-810663675',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b822a2f291ff497aaaf66c26ed6afc79',ramdisk_id='',reservation_id='r-7s2xsdsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-560099641',owner_user_name='tempest-TaggedBootDevicesTest_v242-560099641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fc4aba6767a4af9899ac437ab183df8',uuid=10290935-3f12-4e11-9495-f9c037e89875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converting VIF {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa83e5bb1-2b, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:02 user nova-compute[71269]: INFO os_vif [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:17:6a,bridge_name='br-int',has_traffic_filtering=True,id=a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e,network=Network(7aa77531-64a5-4665-b872-2e1cdbf9d9a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83e5bb1-2b')
Apr 13 23:06:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTVJWGeD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:06:02 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b242e0-62a8-4ef9-bd9d-95162e9d0544]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:06:02 user nova-compute[71269]: No targets found.
Apr 13 23:06:02 user nova-compute[71269]: iSNS:
Apr 13 23:06:02 user nova-compute[71269]: No targets found.
Apr 13 23:06:02 user nova-compute[71269]: STATIC:
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:06:02 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:02 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:02 user nova-compute[71269]: FIRMWARE:
Apr 13 23:06:02 user nova-compute[71269]: No targets found.
Apr 13 23:06:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:06:02 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:06:02 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc0bb6-2ad2-418b-bc00-6e9799499b61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a013756-8894-41a4-b4e1-269282cc97fc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:02 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2b43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4'): ({'sdf'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Removing single pathed devices sdf {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ef4037-a265-4c96-b3b3-97f6d7f7fdc3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c332714f-25ad-433a-92b0-bb1a43d6c425]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flushing IO for device /dev/sdf {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f414de5-7238-44e4-830a-fde581e33020]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a89cc1-2587-4730-8d0d-2186efc8076e]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] SCSI volumes sdf have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a77026-d4c2-4d1b-b904-4fd18166cbea]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2bc66-9ec1-4c13-81cf-66a47e0af2ee]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260]
Apr 13 23:06:03 user nova-compute[71269]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4, portal: 172.16.0.220,3260] successful.
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdbff832-3d46-47da-8cae-62aa661d6ed4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[307926c1-63de-4bd1-bc86-ff60d7f136d9]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== disconnect_volume: return (351ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqpcxEvy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-03889253-8210-430d-b5a9-47d58c066803 for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-d6a692ff-983e-4d9b-abb2-45fee280cb60 for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-1ac87cb8-c399-471e-a808-a54ae2632402 req-5144b1a7-c36e-4c29-b642-91df7f03f99c service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ad651a01-eb81-4baf-8b6c-ff196a729d67 for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14315ef-1cea-4caa-84c7-46d78f9b56d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]: iSNS:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]: STATIC:
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: FIRMWARE:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:06:03 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:06:03 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d2571-25e9-4b04-ab49-e73e33858674]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80573257-2067-4192-888f-e074c67d4fef]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c18acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1'): ({'sdg'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Removing single pathed devices sdg {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98e4cf-e22c-430b-ac51-0f60d0a98e94]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-77b2db4a-b1bb-4628-a21a-1e24199cf117 for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-ec62d21a-cab5-4c13-85df-0e7134cc11d3 for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-unplugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-unplugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-f0b40605-ff39-475b-ab2d-001858d73e85 req-f4c6f855-dc57-43c2-a87a-42f8873b889d service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8adcfd4-f447-4ba0-91ce-8344b44f0bc5]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flushing IO for device /dev/sdg {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf67b8-afa4-4c42-b331-8547e48d3c29]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd1de68-3c5f-4ad0-9033-dd6e5ff80e03]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] SCSI volumes sdg have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeed840-f077-403c-a1f5-a5304573b69a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[02216845-1a09-4ec1-bfda-20f4063f68a7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260]
Apr 13 23:06:03 user nova-compute[71269]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1, portal: 172.16.0.220,3260] successful.
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7991dbf-7eb4-4f6f-bb32-a2ede19d94b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce6f22-5f2a-4f09-a1a8-bfba156ae236]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== disconnect_volume: return (339ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjwJnhIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Acquiring lock "10290935-3f12-4e11-9495-f9c037e89875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] Lock "10290935-3f12-4e11-9495-f9c037e89875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] No waiting events found dispatching network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:03 user nova-compute[71269]: WARNING nova.compute.manager [req-c5e9ff4d-7930-4188-92b2-7a83c2737c37 req-565155c2-1416-41a6-8740-ab5dc34b7ddf service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received unexpected event network-vif-plugged-56cd2acf-5e6d-4703-a160-2cf983399d6b for instance with vm_state active and task_state deleting.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b519d6-e6bd-4b9e-a890-d9e8de6937ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]: iSNS:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]: STATIC:
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:06:03 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:03 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:03 user nova-compute[71269]: FIRMWARE:
Apr 13 23:06:03 user nova-compute[71269]: No targets found.
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:06:03 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:06:03 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8712fe86-a9ed-4f09-802f-60ac5b8fe3b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a5f5fa-7ee9-4987-9deb-f4192dd0cfd2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:03 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4283304-3607-46f9-ae88-2e68824a4158]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f55a02-70ba-4446-b954-5739c9d5834f]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[86292932-913b-4b0f-9b21-9f946fbb9b31]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b1915-ad0d-4bb3-9e34-0c9664a20d35]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0b27c-1a21-47dd-917a-7c0a0f9d5bc3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c7004-4d74-44c3-a8bb-2e89bde5799b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260]
Apr 13 23:06:03 user nova-compute[71269]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097, portal: 172.16.0.220,3260] successful.
Apr 13 23:06:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca331d15-300c-4c30-b73c-3ec9156d8097 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[db401916-e8a0-4b92-8001-9cbf9f9e9308]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] <== disconnect_volume: return (318ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:06:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Deleting instance files /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875_del
Apr 13 23:06:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Deletion of /opt/stack/data/nova/instances/10290935-3f12-4e11-9495-f9c037e89875_del complete
Apr 13 23:06:03 user nova-compute[71269]: INFO nova.compute.manager [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Took 3.08 seconds to destroy the instance on the hypervisor.
Apr 13 23:06:03 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:06:03 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:06:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-deleted-ad651a01-eb81-4baf-8b6c-ff196a729d67 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:05 user nova-compute[71269]: INFO nova.compute.manager [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Neutron deleted interface ad651a01-eb81-4baf-8b6c-ff196a729d67; detaching it from the instance and deleting it from the info cache
Apr 13 23:06:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [{"id": "03889253-8210-430d-b5a9-47d58c066803", "address": "fa:16:3e:65:8d:fc", "network": {"id": "d1c8df15-f9c6-4610-9aa6-ada35fdc3f59", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-483600437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03889253-82", "ovs_interfaceid": "03889253-8210-430d-b5a9-47d58c066803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "address": "fa:16:3e:18:34:31", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77b2db4a-b1", "ovs_interfaceid": "77b2db4a-b1bb-4628-a21a-1e24199cf117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "address": "fa:16:3e:7c:2f:fb", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec62d21a-ca", "ovs_interfaceid": "ec62d21a-cab5-4c13-85df-0e7134cc11d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "address": "fa:16:3e:82:50:a9", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cd2acf-5e", "ovs_interfaceid": "56cd2acf-5e6d-4703-a160-2cf983399d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "address": "fa:16:3e:1f:89:14", "network": {"id": "9e024860-32be-4c74-b371-c7a8b93537c9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1092423337", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a692ff-98", "ovs_interfaceid": "d6a692ff-983e-4d9b-abb2-45fee280cb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "address": "fa:16:3e:f0:17:6a", "network": {"id": "7aa77531-64a5-4665-b872-2e1cdbf9d9a3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1030703558", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b822a2f291ff497aaaf66c26ed6afc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83e5bb1-2b", "ovs_interfaceid": "a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-de43dcb3-9aec-4040-8cdb-cba83414c385 req-95f3e7b7-5e7c-431d-b78d-34541c6c5b6f service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Detach interface failed, port_id=ad651a01-eb81-4baf-8b6c-ff196a729d67, reason: Instance 10290935-3f12-4e11-9495-f9c037e89875 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:06:07 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:07 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Took 3.69 seconds to deallocate network for instance.
Apr 13 23:06:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-deleted-d6a692ff-983e-4d9b-abb2-45fee280cb60 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-deleted-a83e5bb1-2b9f-4f79-9de2-ded40f6fa06e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-deleted-56cd2acf-5e6d-4703-a160-2cf983399d6b {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0940778-c074-42ec-b5b8-d10c688e4db8 req-2af4e697-14ee-422c-8375-deb476d66237 service nova] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Received event network-vif-deleted-03889253-8210-430d-b5a9-47d58c066803 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:09 user nova-compute[71269]: INFO nova.compute.manager [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Took 2.26 seconds to detach 3 volumes for instance.
Apr 13 23:06:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:06:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:06:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:10 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Deleted allocations for instance 10290935-3f12-4e11-9495-f9c037e89875
Apr 13 23:06:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-910e2a9b-7af4-4da6-985d-73f6b118eeba tempest-TaggedBootDevicesTest_v242-560099641 tempest-TaggedBootDevicesTest_v242-560099641-project-member] Lock "10290935-3f12-4e11-9495-f9c037e89875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.553s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:11 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427156.543803, 47dce1cc-c872-41f3-81af-acfc6ccabe18 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:06:11 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] VM Stopped (Lifecycle Event)
Apr 13 23:06:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b7b25431-2178-481f-ae9a-bdf1e0ac730b None None] [instance: 47dce1cc-c872-41f3-81af-acfc6ccabe18] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:06:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:15 user nova-compute[71269]: INFO nova.compute.manager [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Terminating instance
Apr 13 23:06:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-unplugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] No waiting events found dispatching network-vif-unplugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-283987d3-f0b6-4f4c-a4f1-dfecd8242b77 req-641cc86f-18a5-4945-8f00-43943edf577b service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-unplugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:06:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Instance destroyed successfully.
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lazy-loading 'resources' on Instance uuid 454fafc9-4b6f-40c3-80fa-d590fb946889 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-947473118',display_name='tempest-AttachVolumeNegativeTest-server-947473118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-947473118',id=27,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnOM9oAIvYAaqonstAu0i79x5C14LxizYJ582GKlS7wdPZc54wVauzPY4OtlQHFLxduXboFLe6QmDOJ72hstQUoK/NDE7whGNJS43ASabOJL/ItpHphysZg+R09NEMAOQ==',key_name='tempest-keypair-661625581',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:03:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ccac99656842aca44f9f1eb7aa167a',ramdisk_id='',reservation_id='r-gqjeeb4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-704876090',owner_user_name='tempest-AttachVolumeNegativeTest-704876090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98594f3f6ccf4ffdbfd91bcf192d936e',uuid=454fafc9-4b6f-40c3-80fa-d590fb946889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converting VIF {"id": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "address": "fa:16:3e:d3:ef:a2", "network": {"id": "d59145a7-f00c-4cd3-ab12-f4b6ae2608cf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672774066-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ccac99656842aca44f9f1eb7aa167a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eef61bd-35", "ovs_interfaceid": "4eef61bd-3529-4ab4-9f58-881fac9cc1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG os_vif [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eef61bd-35, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:16 user nova-compute[71269]: INFO os_vif [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ef:a2,bridge_name='br-int',has_traffic_filtering=True,id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6,network=Network(d59145a7-f00c-4cd3-ab12-f4b6ae2608cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eef61bd-35')
Apr 13 23:06:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Deleting instance files /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889_del
Apr 13 23:06:16 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Deletion of /opt/stack/data/nova/instances/454fafc9-4b6f-40c3-80fa-d590fb946889_del complete
Apr 13 23:06:16 user nova-compute[71269]: INFO nova.compute.manager [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 23:06:16 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:06:16 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427162.408009, 10290935-3f12-4e11-9495-f9c037e89875 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:06:17 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 10290935-3f12-4e11-9495-f9c037e89875] VM Stopped (Lifecycle Event)
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b515b16b-cf6c-4fce-82ef-938d2c753de7 None None] [instance: 10290935-3f12-4e11-9495-f9c037e89875] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-deleted-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:17 user nova-compute[71269]: INFO nova.compute.manager [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Neutron deleted interface 4eef61bd-3529-4ab4-9f58-881fac9cc1d6; detaching it from the instance and deleting it from the info cache
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:17 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Took 0.85 seconds to deallocate network for instance.
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c4a1358-5572-43fa-b115-543d25c53d06 req-d4747dc5-e9c2-4696-96d2-79aad17a97ef service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Detach interface failed, port_id=4eef61bd-3529-4ab4-9f58-881fac9cc1d6, reason: Instance 454fafc9-4b6f-40c3-80fa-d590fb946889 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:06:17 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:18 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Deleted allocations for instance 454fafc9-4b6f-40c3-80fa-d590fb946889
Apr 13 23:06:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3fac2ab5-b2d4-4d0c-88e6-f2b51fba6f3a tempest-AttachVolumeNegativeTest-704876090 tempest-AttachVolumeNegativeTest-704876090-project-member] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Acquiring lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] Lock "454fafc9-4b6f-40c3-80fa-d590fb946889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] No waiting events found dispatching network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:06:18 user nova-compute[71269]: WARNING nova.compute.manager [req-eaabe2a4-eddb-476e-b082-955d0c6f5d26 req-d605dffe-a7c9-4971-b5aa-dca439c77de4 service nova] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Received unexpected event network-vif-plugged-4eef61bd-3529-4ab4-9f58-881fac9cc1d6 for instance with vm_state deleted and task_state None.
Apr 13 23:06:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:06:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:31 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427176.6792107, 454fafc9-4b6f-40c3-80fa-d590fb946889 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:06:31 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] VM Stopped (Lifecycle Event)
Apr 13 23:06:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7394f49c-3080-41a9-a5c5-9bae2394f282 None None] [instance: 454fafc9-4b6f-40c3-80fa-d590fb946889] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:06:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing instance network info cache due to event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updated VIF entry in instance network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-091c59ca-1c01-489c-b5f7-49ec5ee1cf0b req-6be592cb-dc03-4e8a-b8be-76d312fcbc5d service nova] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:44 user nova-compute[71269]: INFO nova.compute.manager [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Detaching volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:06:44 user nova-compute[71269]: INFO nova.virt.block_device [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Attempting to driver detach volume 2ac485a1-6354-4559-bc5d-5a22d6dfc7aa from mountpoint /dev/vdb
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Attempting to detach device vdb from instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:06:44 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:06:44 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:06:44 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:06:44 user nova-compute[71269]:   <serial>2ac485a1-6354-4559-bc5d-5a22d6dfc7aa</serial>
Apr 13 23:06:44 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:06:44 user nova-compute[71269]: </disk>
Apr 13 23:06:44 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:06:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully detached device vdb from instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 from the persistent domain config.
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:06:44 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:06:44 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:06:44 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:06:44 user nova-compute[71269]:   <serial>2ac485a1-6354-4559-bc5d-5a22d6dfc7aa</serial>
Apr 13 23:06:44 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:06:44 user nova-compute[71269]: </disk>
Apr 13 23:06:44 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427204.8873, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:06:44 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully detached device vdb from instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 from the live domain config.
Apr 13 23:06:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBdTvtrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:06:44 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db34f40-9626-4799-a031-2975d8bc8e5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:06:44 user nova-compute[71269]: No targets found.
Apr 13 23:06:44 user nova-compute[71269]: iSNS:
Apr 13 23:06:44 user nova-compute[71269]: No targets found.
Apr 13 23:06:44 user nova-compute[71269]: STATIC:
Apr 13 23:06:44 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:06:44 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:44 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:44 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:06:44 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:44 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:44 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa
Apr 13 23:06:44 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:44 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:44 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:06:44 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:06:44 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:06:44 user nova-compute[71269]: FIRMWARE:
Apr 13 23:06:44 user nova-compute[71269]: No targets found.
Apr 13 23:06:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:06:44 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:06:44 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd1f88-381f-46cd-a04b-f77221b4e647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d1509f-cf89-409d-b0ea-d85569feafdb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa (non-flash)
Apr 13 23:06:44 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:06:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc7bb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:06:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d10958-7c10-4f85-8154-b8994e7f4645]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277ff77-63ff-43a6-829c-eb8f2755c7ad]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd12d689-6ee7-4a68-8629-587274e39459]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d877c-164c-49d6-b6f0-b01a9ead97f6]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca329eb5-a7d5-409b-8635-5cc5a16e9d65]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f6f09-eba3-4611-b657-ef11b993a7fb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260]
Apr 13 23:06:45 user nova-compute[71269]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa, portal: 172.16.0.220,3260] successful.
Apr 13 23:06:45 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac485a1-6354-4559-bc5d-5a22d6dfc7aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de51d1c-a983-44f2-9889-7b011a2057e3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] <== disconnect_volume: return (309ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing instance network info cache due to event network-changed-95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Acquiring lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Acquired lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG nova.network.neutron [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Refreshing network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:06:45 user nova-compute[71269]: DEBUG nova.network.neutron [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updated VIF entry in instance network info cache for port 95b6eed4-ff6e-493e-a912-d263def87a82. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:06:46 user nova-compute[71269]: DEBUG nova.network.neutron [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [{"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:06:46 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'flavor' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:06:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c9377807-1501-46ce-94cb-d3f64ee580a7 req-41b362a0-f123-4fa4-97e5-947947a9418c service nova] Releasing lock "refresh_cache-70c7e35a-9a30-44ff-bb5f-74d122bf08d2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:06:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a4dc7fe8-a433-4c12-928b-1a2703713cd5 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:51 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:06:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:06:55 user nova-compute[71269]: INFO nova.compute.manager [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] instance snapshotting
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Beginning live snapshot process
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254.delta 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254.delta 1073741824" returned: 0 in 0.054s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 23:06:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254.delta /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254.delta /opt/stack/data/nova/instances/snapshots/tmpj3255bce/a1dee6bb59da4c5ebaac1ef6692fb254" returned: 0 in 0.774s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:06:58 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Snapshot extracted, beginning image upload
Apr 13 23:06:58 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:06:58 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7859MB free_disk=26.247196197509766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a83b839-7b5b-4004-94da-d196d18caf0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:06:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:07:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Snapshot image upload complete
Apr 13 23:07:00 user nova-compute[71269]: INFO nova.compute.manager [None req-1fabfce1-6671-4e05-bff3-70660faf6630 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Took 5.59 seconds to snapshot the instance on the hypervisor.
Apr 13 23:07:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:07:00 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [{"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-df12dd8d-ea02-4c59-804d-52ae1bd4a555" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:06 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:07:06 user nova-compute[71269]: INFO nova.compute.claims [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Claim successful on node user
Apr 13 23:07:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:07:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:07:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Creating image(s)
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "/opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "/opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "/opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.policy [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1114619485574b9499b5384a9529003f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ecbdf826b849bf995787ada9d4a673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk 1073741824" returned: 0 in 0.048s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:07:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Cannot resize image /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lazy-loading 'migration_context' on Instance uuid 392704a5-705a-43d0-bab8-801c7ef5b514 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Ensure instance console log exists: /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Successfully created port: e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Successfully updated port: e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquired lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-changed-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Refreshing instance network info cache due to event network-changed-e6adbdf3-3dac-401e-a86f-51f53230f579. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Acquiring lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:07:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Updating instance_info_cache with network_info: [{"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Releasing lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Instance network_info: |[{"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Acquired lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Refreshing network info cache for port e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Start _get_guest_xml network_info=[{"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:07:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-109950942',display_name='tempest-VolumesActionsTest-instance-109950942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-109950942',id=32,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12ecbdf826b849bf995787ada9d4a673',ramdisk_id='',reservation_id='r-puf3s2wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1315360402',owner_user_name='tempest-VolumesActionsTest-1315360402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:07Z,user_data=None,user_id='1114619485574b9499b5384a9529003f',uuid=392704a5-705a-43d0-bab8-801c7ef5b514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converting VIF {"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lazy-loading 'pci_devices' on Instance uuid 392704a5-705a-43d0-bab8-801c7ef5b514 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:07:10 user nova-compute[71269]:   <uuid>392704a5-705a-43d0-bab8-801c7ef5b514</uuid>
Apr 13 23:07:10 user nova-compute[71269]:   <name>instance-00000020</name>
Apr 13 23:07:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:07:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:07:10 user nova-compute[71269]:   <metadata>
Apr 13 23:07:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:07:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:name>tempest-VolumesActionsTest-instance-109950942</nova:name>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:07:10</nova:creationTime>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:07:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:07:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:owner>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:user uuid="1114619485574b9499b5384a9529003f">tempest-VolumesActionsTest-1315360402-project-member</nova:user>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:project uuid="12ecbdf826b849bf995787ada9d4a673">tempest-VolumesActionsTest-1315360402</nova:project>
Apr 13 23:07:10 user nova-compute[71269]:       </nova:owner>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:07:10 user nova-compute[71269]:       <nova:ports>
Apr 13 23:07:10 user nova-compute[71269]:         <nova:port uuid="e6adbdf3-3dac-401e-a86f-51f53230f579">
Apr 13 23:07:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 23:07:10 user nova-compute[71269]:         </nova:port>
Apr 13 23:07:10 user nova-compute[71269]:       </nova:ports>
Apr 13 23:07:10 user nova-compute[71269]:     </nova:instance>
Apr 13 23:07:10 user nova-compute[71269]:   </metadata>
Apr 13 23:07:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:07:10 user nova-compute[71269]:     <system>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="serial">392704a5-705a-43d0-bab8-801c7ef5b514</entry>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="uuid">392704a5-705a-43d0-bab8-801c7ef5b514</entry>
Apr 13 23:07:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:07:10 user nova-compute[71269]:     </system>
Apr 13 23:07:10 user nova-compute[71269]:   </sysinfo>
Apr 13 23:07:10 user nova-compute[71269]:   <os>
Apr 13 23:07:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:07:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:07:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:07:10 user nova-compute[71269]:   </os>
Apr 13 23:07:10 user nova-compute[71269]:   <features>
Apr 13 23:07:10 user nova-compute[71269]:     <acpi/>
Apr 13 23:07:10 user nova-compute[71269]:     <apic/>
Apr 13 23:07:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:07:10 user nova-compute[71269]:   </features>
Apr 13 23:07:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:07:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:07:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:07:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:07:10 user nova-compute[71269]:   </clock>
Apr 13 23:07:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:07:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:07:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:07:10 user nova-compute[71269]:   </cpu>
Apr 13 23:07:10 user nova-compute[71269]:   <devices>
Apr 13 23:07:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:07:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:07:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk"/>
Apr 13 23:07:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:07:10 user nova-compute[71269]:     </disk>
Apr 13 23:07:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:07:10 user nova-compute[71269]:       <mac address="fa:16:3e:3a:41:f6"/>
Apr 13 23:07:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:07:10 user nova-compute[71269]:       <target dev="tape6adbdf3-3d"/>
Apr 13 23:07:10 user nova-compute[71269]:     </interface>
Apr 13 23:07:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:07:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/console.log" append="off"/>
Apr 13 23:07:10 user nova-compute[71269]:     </serial>
Apr 13 23:07:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:07:10 user nova-compute[71269]:     <video>
Apr 13 23:07:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:10 user nova-compute[71269]:     </video>
Apr 13 23:07:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:07:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:07:10 user nova-compute[71269]:     </rng>
Apr 13 23:07:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:07:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:07:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:07:10 user nova-compute[71269]:     </memballoon>
Apr 13 23:07:10 user nova-compute[71269]:   </devices>
Apr 13 23:07:10 user nova-compute[71269]: </domain>
Apr 13 23:07:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-109950942',display_name='tempest-VolumesActionsTest-instance-109950942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-109950942',id=32,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12ecbdf826b849bf995787ada9d4a673',ramdisk_id='',reservation_id='r-puf3s2wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1315360402',owner_user_name='tempest-VolumesActionsTest-1315360402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:07Z,user_data=None,user_id='1114619485574b9499b5384a9529003f',uuid=392704a5-705a-43d0-bab8-801c7ef5b514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converting VIF {"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG os_vif [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6adbdf3-3d, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6adbdf3-3d, col_values=(('external_ids', {'iface-id': 'e6adbdf3-3dac-401e-a86f-51f53230f579', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:41:f6', 'vm-uuid': '392704a5-705a-43d0-bab8-801c7ef5b514'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:10 user nova-compute[71269]: INFO os_vif [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d')
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] No VIF found with MAC fa:16:3e:3a:41:f6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Updated VIF entry in instance network info cache for port e6adbdf3-3dac-401e-a86f-51f53230f579. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Updating instance_info_cache with network_info: [{"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-66f848bc-1472-4732-becb-124f6e3256b7 req-4675652c-3513-4ba3-b88e-9c26d4aee1e4 service nova] Releasing lock "refresh_cache-392704a5-705a-43d0-bab8-801c7ef5b514" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] No waiting events found dispatching network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:11 user nova-compute[71269]: WARNING nova.compute.manager [req-070b2140-0f6a-4cd1-96fa-090e8989280c req-594f7f28-811c-4b44-9da4-c01fa9049d9d service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received unexpected event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 for instance with vm_state building and task_state spawning.
Apr 13 23:07:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427233.868975, 392704a5-705a-43d0-bab8-801c7ef5b514 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] VM Resumed (Lifecycle Event)
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:07:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Instance spawned successfully.
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427233.8737965, 392704a5-705a-43d0-bab8-801c7ef5b514 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] VM Started (Lifecycle Event)
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Took 6.60 seconds to spawn the instance on the hypervisor.
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] No waiting events found dispatching network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:14 user nova-compute[71269]: WARNING nova.compute.manager [req-4668b478-4045-4bc1-bf4b-5149c5d5d524 req-31ffb5c3-bfd3-4746-a1ec-c9710a474460 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received unexpected event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 for instance with vm_state building and task_state spawning.
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.compute.manager [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Took 7.42 seconds to build instance.
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-429fd635-0568-463b-96ed-c0b8e489724b tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.531s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.compute.manager [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Detaching volume 642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.virt.block_device [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Attempting to driver detach volume 642f82bc-0cb0-4600-b66e-9d8ab2b0a083 from mountpoint /dev/vdb
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Attempting to detach device vdb from instance deb24b5e-f858-4068-88c5-3c7708c7e195 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:07:14 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:07:14 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:07:14 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:07:14 user nova-compute[71269]:   <serial>642f82bc-0cb0-4600-b66e-9d8ab2b0a083</serial>
Apr 13 23:07:14 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:07:14 user nova-compute[71269]: </disk>
Apr 13 23:07:14 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:07:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully detached device vdb from instance deb24b5e-f858-4068-88c5-3c7708c7e195 from the persistent domain config.
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance deb24b5e-f858-4068-88c5-3c7708c7e195 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:07:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:07:14 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:07:14 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:07:14 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:07:14 user nova-compute[71269]:   <serial>642f82bc-0cb0-4600-b66e-9d8ab2b0a083</serial>
Apr 13 23:07:14 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:07:14 user nova-compute[71269]: </disk>
Apr 13 23:07:14 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427235.2352026, deb24b5e-f858-4068-88c5-3c7708c7e195 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:07:15 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully detached device vdb from instance deb24b5e-f858-4068-88c5-3c7708c7e195 from the live domain config.
Apr 13 23:07:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BanCmNSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:07:15 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c720b-e0a7-4f0b-aa8d-286aec52bc58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:07:15 user nova-compute[71269]: No targets found.
Apr 13 23:07:15 user nova-compute[71269]: iSNS:
Apr 13 23:07:15 user nova-compute[71269]: No targets found.
Apr 13 23:07:15 user nova-compute[71269]: STATIC:
Apr 13 23:07:15 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083
Apr 13 23:07:15 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:07:15 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:07:15 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:07:15 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:07:15 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:07:15 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:07:15 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:07:15 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:07:15 user nova-compute[71269]: FIRMWARE:
Apr 13 23:07:15 user nova-compute[71269]: No targets found.
Apr 13 23:07:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:07:15 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:07:15 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3612cc93-a4c6-442f-8800-3c6a88c5ddb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95079ebb-7d04-4315-979a-d83f490e230d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc42b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d32c4-295d-4673-aa40-b7d0d4dabade]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed12a3b-2250-4de3-be69-37cfad21467b]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[434215b3-c593-4496-b8dc-227e04136699]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eadfc8f-890b-4ad0-89dd-953777fa9d6e]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f64fd-8222-4236-8dde-3a65ace62acd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9ce16-9a05-4f0f-8f53-4f2d00a29377]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260]
Apr 13 23:07:15 user nova-compute[71269]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083, portal: 172.16.0.220,3260] successful.
Apr 13 23:07:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642f82bc-0cb0-4600-b66e-9d8ab2b0a083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbacf3ad-00c1-4263-abeb-f8c4d91f4df4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] <== disconnect_volume: return (325ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:07:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing instance network info cache due to event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'flavor' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-187c8179-7c69-41ba-bbd6-afcb372a69bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.937s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updated VIF entry in instance network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing instance network info cache due to event network-changed-c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Acquiring lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Acquired lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Refreshing network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing instance network info cache due to event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Acquiring lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Acquired lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updated VIF entry in instance network info cache for port c7f804a4-0e8d-4d99-a547-5c9252cb872c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [{"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ea3693fd-4bec-4dce-91cf-e753d180416c req-f660a6c3-9585-449a-95ad-849f38ee013d service nova] Releasing lock "refresh_cache-deb24b5e-f858-4068-88c5-3c7708c7e195" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updated VIF entry in instance network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating instance_info_cache with network_info: [{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-656b8674-4fd5-4d9a-b4db-2cc2c9925229 req-f10b3b22-7447-44db-9329-f7aefb0a7fe7 service nova] Releasing lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:24 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:07:24 user nova-compute[71269]: INFO nova.compute.claims [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Claim successful on node user
Apr 13 23:07:24 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:07:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.policy [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:07:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating image(s)
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.162s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk 1073741824" returned: 0 in 0.055s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:07:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Successfully created port: 09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Cannot resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'migration_context' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:07:26 user nova-compute[71269]: INFO nova.compute.claims [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Claim successful on node user
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Successfully updated port: 09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-changed-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Refreshing instance network info cache due to event network-changed-09cc0c17-bd49-4207-9de4-89178a1e681e. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:07:26 user nova-compute[71269]: INFO nova.virt.block_device [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Booting with volume cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf at /dev/vda
Apr 13 23:07:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.utils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35e601-e579-4653-b86b-abd68c17f435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f1a6b-9799-4d5a-8130-c1bb29233f28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.policy [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b289294050af4c41aeef8401832487a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd872848d5dc1471996e2f33bbbdebbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0ea2e-a705-4217-afb0-68297c9355a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee9b50-3575-4835-aea9-582aad3cee52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:07:27 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7064e-d189-45cc-91b5-4d3275c5da65]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_brick.utils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating existing volume attachment record: 94d4f96c-acf7-43ea-b2c2-96cfb60d70a1 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance network_info: |[{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Refreshing network info cache for port 09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start _get_guest_xml network_info=[{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:07:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-1074557247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:07:27 user nova-compute[71269]:   <uuid>d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</uuid>
Apr 13 23:07:27 user nova-compute[71269]:   <name>instance-00000021</name>
Apr 13 23:07:27 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:07:27 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:07:27 user nova-compute[71269]:   <metadata>
Apr 13 23:07:27 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:07:27 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-1074557247</nova:name>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:07:27</nova:creationTime>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:07:27 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:07:27 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:owner>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:07:27 user nova-compute[71269]:       </nova:owner>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:07:27 user nova-compute[71269]:       <nova:ports>
Apr 13 23:07:27 user nova-compute[71269]:         <nova:port uuid="09cc0c17-bd49-4207-9de4-89178a1e681e">
Apr 13 23:07:27 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:07:27 user nova-compute[71269]:         </nova:port>
Apr 13 23:07:27 user nova-compute[71269]:       </nova:ports>
Apr 13 23:07:27 user nova-compute[71269]:     </nova:instance>
Apr 13 23:07:27 user nova-compute[71269]:   </metadata>
Apr 13 23:07:27 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:07:27 user nova-compute[71269]:     <system>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="serial">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="uuid">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:07:27 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:07:27 user nova-compute[71269]:     </system>
Apr 13 23:07:27 user nova-compute[71269]:   </sysinfo>
Apr 13 23:07:27 user nova-compute[71269]:   <os>
Apr 13 23:07:27 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:07:27 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:07:27 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:07:27 user nova-compute[71269]:   </os>
Apr 13 23:07:27 user nova-compute[71269]:   <features>
Apr 13 23:07:27 user nova-compute[71269]:     <acpi/>
Apr 13 23:07:27 user nova-compute[71269]:     <apic/>
Apr 13 23:07:27 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:07:27 user nova-compute[71269]:   </features>
Apr 13 23:07:27 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:07:27 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:07:27 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:07:27 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:07:27 user nova-compute[71269]:   </clock>
Apr 13 23:07:27 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:07:27 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:07:27 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:07:27 user nova-compute[71269]:   </cpu>
Apr 13 23:07:27 user nova-compute[71269]:   <devices>
Apr 13 23:07:27 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:07:27 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:07:27 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk"/>
Apr 13 23:07:27 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:07:27 user nova-compute[71269]:     </disk>
Apr 13 23:07:27 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:07:27 user nova-compute[71269]:       <mac address="fa:16:3e:23:cf:d9"/>
Apr 13 23:07:27 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:27 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:07:27 user nova-compute[71269]:       <target dev="tap09cc0c17-bd"/>
Apr 13 23:07:27 user nova-compute[71269]:     </interface>
Apr 13 23:07:27 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:07:27 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log" append="off"/>
Apr 13 23:07:27 user nova-compute[71269]:     </serial>
Apr 13 23:07:27 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:07:27 user nova-compute[71269]:     <video>
Apr 13 23:07:27 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:27 user nova-compute[71269]:     </video>
Apr 13 23:07:27 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:07:27 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:07:27 user nova-compute[71269]:     </rng>
Apr 13 23:07:27 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:07:27 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:07:27 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:07:27 user nova-compute[71269]:     </memballoon>
Apr 13 23:07:27 user nova-compute[71269]:   </devices>
Apr 13 23:07:27 user nova-compute[71269]: </domain>
Apr 13 23:07:27 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-1074557247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG os_vif [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09cc0c17-bd, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09cc0c17-bd, col_values=(('external_ids', {'iface-id': '09cc0c17-bd49-4207-9de4-89178a1e681e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:cf:d9', 'vm-uuid': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:27 user nova-compute[71269]: INFO os_vif [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:07:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:23:cf:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Successfully created port: e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updated VIF entry in instance network info cache for port 09cc0c17-bd49-4207-9de4-89178a1e681e. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4958014d-9f3b-4595-b2a6-cf443bdbdd1f req-579461e3-5d1d-4c0d-b8f4-d6b1c94d0040 service nova] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Successfully updated port: e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquired lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing instance network info cache due to event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Acquiring lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:07:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:29 user nova-compute[71269]: WARNING nova.compute.manager [req-f331a891-3db2-4170-b259-3b6fbadd79cd req-190cb870-5189-4449-8b6a-cdab28eec367 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state building and task_state spawning.
Apr 13 23:07:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating instance_info_cache with network_info: [{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Releasing lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Instance network_info: |[{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Acquired lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updated VIF entry in instance network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:07:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating instance_info_cache with network_info: [{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60872089-a180-4cf8-8e4a-6835a6467965 req-8135099d-2cf4-4acd-bbfb-a4a7e3855b30 service nova] Releasing lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427251.2723517, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Resumed (Lifecycle Event)
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance spawned successfully.
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427251.2776768, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Started (Lifecycle Event)
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:31 user nova-compute[71269]: WARNING nova.compute.manager [req-bb479c92-3f6c-4fc1-9ae5-69705012b423 req-334d1637-bb2e-45f7-83b2-eee16d6363d1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state building and task_state spawning.
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Took 5.95 seconds to spawn the instance on the hypervisor.
Apr 13 23:07:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:31 user nova-compute[71269]: INFO nova.compute.manager [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Took 7.09 seconds to build instance.
Apr 13 23:07:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-14b199ae-847a-45af-8916-ea6b9814198c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:07:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Creating image(s)
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Ensure instance console log exists: /opt/stack/data/nova/instances/1a9f5f1f-cc46-4c3c-834d-daa002031ee3/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Start _get_guest_xml network_info=[{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '94d4f96c-acf7-43ea-b2c2-96cfb60d70a1', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaVjmkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a9f5f1f-cc46-4c3c-834d-daa002031ee3', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 'serial': 'cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:07:32 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:32 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaVjmkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:07:32 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:07:32 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:07:32 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ca7d8-926d-4014-bd09-a8dd68baf25a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:07:32 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aac246-4ab9-4d8e-96f5-e52a6b03df18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf] added
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[391df326-7b18-4252-a636-9bff98015e85]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3685665-e1f1-4522-bc28-99d8b742625e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIaVjmkS {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIaVjmkS" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac06a4d-7dba-42f3-9103-f526666681c6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hIaVjmkS'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b4e0ff-c77c-4ef5-85b6-b9fd65c0c85a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fcbbba-4558-443c-b549-3adb14699aac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1584c33f-3b2c-4830-bb4a-473894569cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260]
Apr 13 23:07:32 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260] successful.
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b46b1e-06ea-455d-87f7-d336857b311c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd8433-fece-4da4-a4a2-ab4d60619a44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:07:32 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:07:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b395af4-21fd-485d-a65b-412d0b7c8878]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaVjmkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:07:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23765396532323639', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765396532323639', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803529970',display_name='tempest-TestVolumeBootPattern-server-803529970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803529970',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-5swkcffi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:27Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a9f5f1f-cc46-4c3c-834d-daa002031ee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:07:33 user nova-compute[71269]:   <uuid>1a9f5f1f-cc46-4c3c-834d-daa002031ee3</uuid>
Apr 13 23:07:33 user nova-compute[71269]:   <name>instance-00000022</name>
Apr 13 23:07:33 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:07:33 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:07:33 user nova-compute[71269]:   <metadata>
Apr 13 23:07:33 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:07:33 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:07:33 user nova-compute[71269]:       <nova:name>tempest-TestVolumeBootPattern-server-803529970</nova:name>
Apr 13 23:07:33 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:07:32</nova:creationTime>
Apr 13 23:07:33 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:07:33 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:07:33 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:07:33 user nova-compute[71269]:       <nova:owner>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:user uuid="b289294050af4c41aeef8401832487a1">tempest-TestVolumeBootPattern-751187467-project-member</nova:user>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:project uuid="d872848d5dc1471996e2f33bbbdebbd9">tempest-TestVolumeBootPattern-751187467</nova:project>
Apr 13 23:07:33 user nova-compute[71269]:       </nova:owner>
Apr 13 23:07:33 user nova-compute[71269]:       <nova:ports>
Apr 13 23:07:33 user nova-compute[71269]:         <nova:port uuid="e1ea4927-3d26-47cf-8db8-daa6fe358335">
Apr 13 23:07:33 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:07:33 user nova-compute[71269]:         </nova:port>
Apr 13 23:07:33 user nova-compute[71269]:       </nova:ports>
Apr 13 23:07:33 user nova-compute[71269]:     </nova:instance>
Apr 13 23:07:33 user nova-compute[71269]:   </metadata>
Apr 13 23:07:33 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:07:33 user nova-compute[71269]:     <system>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="serial">1a9f5f1f-cc46-4c3c-834d-daa002031ee3</entry>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="uuid">1a9f5f1f-cc46-4c3c-834d-daa002031ee3</entry>
Apr 13 23:07:33 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:07:33 user nova-compute[71269]:     </system>
Apr 13 23:07:33 user nova-compute[71269]:   </sysinfo>
Apr 13 23:07:33 user nova-compute[71269]:   <os>
Apr 13 23:07:33 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:07:33 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:07:33 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:07:33 user nova-compute[71269]:   </os>
Apr 13 23:07:33 user nova-compute[71269]:   <features>
Apr 13 23:07:33 user nova-compute[71269]:     <acpi/>
Apr 13 23:07:33 user nova-compute[71269]:     <apic/>
Apr 13 23:07:33 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:07:33 user nova-compute[71269]:   </features>
Apr 13 23:07:33 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:07:33 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:07:33 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:07:33 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:07:33 user nova-compute[71269]:   </clock>
Apr 13 23:07:33 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:07:33 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:07:33 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:07:33 user nova-compute[71269]:   </cpu>
Apr 13 23:07:33 user nova-compute[71269]:   <devices>
Apr 13 23:07:33 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:07:33 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:07:33 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:07:33 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:07:33 user nova-compute[71269]:       <serial>cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf</serial>
Apr 13 23:07:33 user nova-compute[71269]:     </disk>
Apr 13 23:07:33 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:07:33 user nova-compute[71269]:       <mac address="fa:16:3e:a1:e0:3e"/>
Apr 13 23:07:33 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:33 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:07:33 user nova-compute[71269]:       <target dev="tape1ea4927-3d"/>
Apr 13 23:07:33 user nova-compute[71269]:     </interface>
Apr 13 23:07:33 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:07:33 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/1a9f5f1f-cc46-4c3c-834d-daa002031ee3/console.log" append="off"/>
Apr 13 23:07:33 user nova-compute[71269]:     </serial>
Apr 13 23:07:33 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:07:33 user nova-compute[71269]:     <video>
Apr 13 23:07:33 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:07:33 user nova-compute[71269]:     </video>
Apr 13 23:07:33 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:07:33 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:07:33 user nova-compute[71269]:     </rng>
Apr 13 23:07:33 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:07:33 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:07:33 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:07:33 user nova-compute[71269]:     </memballoon>
Apr 13 23:07:33 user nova-compute[71269]:   </devices>
Apr 13 23:07:33 user nova-compute[71269]: </domain>
Apr 13 23:07:33 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803529970',display_name='tempest-TestVolumeBootPattern-server-803529970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803529970',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-5swkcffi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:07:27Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a9f5f1f-cc46-4c3c-834d-daa002031ee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG os_vif [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1ea4927-3d, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1ea4927-3d, col_values=(('external_ids', {'iface-id': 'e1ea4927-3d26-47cf-8db8-daa6fe358335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:e0:3e', 'vm-uuid': '1a9f5f1f-cc46-4c3c-834d-daa002031ee3'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: INFO os_vif [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d')
Apr 13 23:07:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:07:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] No VIF found with MAC fa:16:3e:a1:e0:3e, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] No waiting events found dispatching network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:35 user nova-compute[71269]: WARNING nova.compute.manager [req-0b605300-e46e-4ffd-98cd-bdf7696daf83 req-d13bcf88-c830-4b0f-9d11-5563a6c15dd3 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received unexpected event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance with vm_state building and task_state spawning.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427257.509988, 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] VM Resumed (Lifecycle Event)
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Instance spawned successfully.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] No waiting events found dispatching network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:37 user nova-compute[71269]: WARNING nova.compute.manager [req-d461d011-6519-457c-8f8a-114fc5186d5b req-af7db49a-03ab-4b0e-a409-68de2cb9f24a service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received unexpected event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance with vm_state building and task_state spawning.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427257.5155036, 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] VM Started (Lifecycle Event)
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:07:37 user nova-compute[71269]: INFO nova.compute.manager [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Took 11.53 seconds to build instance.
Apr 13 23:07:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0f337e1e-1397-4f8e-a80e-22dcf86ac677 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.627s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:38 user nova-compute[71269]: INFO nova.compute.manager [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Terminating instance
Apr 13 23:07:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Instance destroyed successfully.
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lazy-loading 'resources' on Instance uuid 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-663169904',display_name='tempest-TestMinimumBasicScenario-server-663169904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-663169904',id=25,image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sGHCLoLvO1a6S/Zt/PEdT7BPKf9ERdMM0FJv9xWt+SMt3ws6LpVhbc/hXC0h4+aCtYPmwhyCNg25B0Fn+l5Ab22CCK9eEL6zQEp3JGKV2S3bXOgj0WJVeX+40Z2Y9eg==',key_name='tempest-TestMinimumBasicScenario-1134301175',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf532d1c87a34b8cbde0f162688f7cdb',ramdisk_id='',reservation_id='r-faapp9hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0e299bea-bdd5-4988-a5dc-230b7bdfa5d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-146514025',owner_user_name='tempest-TestMinimumBasicScenario-146514025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:04:59Z,user_data=None,user_id='fad76e3a6e154feaa62d95f6e7d1ce1c',uuid=70c7e35a-9a30-44ff-bb5f-74d122bf08d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converting VIF {"id": "95b6eed4-ff6e-493e-a912-d263def87a82", "address": "fa:16:3e:00:78:c3", "network": {"id": "31c239a4-3745-4a30-8ac2-820d7bdc9e2a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1660539861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf532d1c87a34b8cbde0f162688f7cdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b6eed4-ff", "ovs_interfaceid": "95b6eed4-ff6e-493e-a912-d263def87a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG os_vif [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95b6eed4-ff, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:39 user nova-compute[71269]: INFO os_vif [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=95b6eed4-ff6e-493e-a912-d263def87a82,network=Network(31c239a4-3745-4a30-8ac2-820d7bdc9e2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b6eed4-ff')
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Deleting instance files /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2_del
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Deletion of /opt/stack/data/nova/instances/70c7e35a-9a30-44ff-bb5f-74d122bf08d2_del complete
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.compute.manager [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-unplugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Acquiring lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] No waiting events found dispatching network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:07:39 user nova-compute[71269]: WARNING nova.compute.manager [req-69d30d90-0641-4870-b6f9-89aa96c3736b req-19e3469a-b3de-4807-b913-dbf1bf106200 service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received unexpected event network-vif-plugged-95b6eed4-ff6e-493e-a912-d263def87a82 for instance with vm_state active and task_state deleting.
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Received event network-vif-deleted-95b6eed4-ff6e-493e-a912-d263def87a82 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.compute.manager [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Neutron deleted interface 95b6eed4-ff6e-493e-a912-d263def87a82; detaching it from the instance and deleting it from the info cache
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.network.neutron [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:07:39 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Took 0.54 seconds to deallocate network for instance.
Apr 13 23:07:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-d5ddc879-5f56-48de-bedd-dccdae90563b req-89a85f2e-2538-47d4-97b7-09da8cbf66cf service nova] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Detach interface failed, port_id=95b6eed4-ff6e-493e-a912-d263def87a82, reason: Instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:40 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:07:40 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:07:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:40 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Deleted allocations for instance 70c7e35a-9a30-44ff-bb5f-74d122bf08d2
Apr 13 23:07:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b371162a-3862-4d96-b170-69c05a980755 tempest-TestMinimumBasicScenario-146514025 tempest-TestMinimumBasicScenario-146514025-project-member] Lock "70c7e35a-9a30-44ff-bb5f-74d122bf08d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:53 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427259.107751, 70c7e35a-9a30-44ff-bb5f-74d122bf08d2 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:07:54 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] VM Stopped (Lifecycle Event)
Apr 13 23:07:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1e2a07e7-65d4-45ba-a245-a07b4c038f32 None None] [instance: 70c7e35a-9a30-44ff-bb5f-74d122bf08d2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:54 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:07:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:07:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=26.17697525024414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance deb24b5e-f858-4068-88c5-3c7708c7e195 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a83b839-7b5b-4004-94da-d196d18caf0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 392704a5-705a-43d0-bab8-801c7ef5b514 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:07:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:07:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:07:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [{"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-ff417f05-3cfa-4274-a0d9-9145ce1e5f83" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:08:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:02 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:08:02 user nova-compute[71269]: INFO nova.compute.claims [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Claim successful on node user
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:08:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:08:03 user nova-compute[71269]: INFO nova.virt.block_device [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Booting with volume-backed-image d6970ace-53c3-48ed-ae08-e4c3846a312a at /dev/vda
Apr 13 23:08:03 user nova-compute[71269]: DEBUG nova.policy [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db44e7cb89a46c2999916b0a266b159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe77a2c491c4596ba7e6af3236d7de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:08:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Successfully created port: 7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:05 user nova-compute[71269]: INFO nova.compute.manager [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Terminating instance
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Successfully updated port: 7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-changed-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Refreshing instance network info cache due to event network-changed-7ae6b103-e1c6-42e6-9fcd-e76353955a76. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Acquiring lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-252cc4bd-81c1-4275-930b-3a5544e40573 req-ff21b370-1224-43c8-b5d4-d4e629778d8f service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-unplugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating instance_info_cache with network_info: [{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance network_info: |[{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Acquired lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Refreshing network info cache for port 7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:08:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Instance destroyed successfully.
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid deb24b5e-f858-4068-88c5-3c7708c7e195 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127216369',display_name='tempest-ServerRescueNegativeTestJSON-server-1127216369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127216369',id=22,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vlH4K190ZLaXGZADGTKyJqq1HrjF8mcn+GStKL4ZJ0L5vSiY+ekY/NcmigKtITRdMzH4ykVfwffOwzTyyJICm8WdBeAnwGlDcy6UYkDS+DFs4nMGVpTbq7hSi2P8hhA==',key_name='tempest-keypair-1129500402',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:03:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-l38vxe9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=deb24b5e-f858-4068-88c5-3c7708c7e195,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "address": "fa:16:3e:d0:65:0c", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f804a4-0e", "ovs_interfaceid": "c7f804a4-0e8d-4d99-a547-5c9252cb872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG os_vif [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f804a4-0e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:05 user nova-compute[71269]: INFO os_vif [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=c7f804a4-0e8d-4d99-a547-5c9252cb872c,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f804a4-0e')
Apr 13 23:08:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Deleting instance files /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195_del
Apr 13 23:08:05 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Deletion of /opt/stack/data/nova/instances/deb24b5e-f858-4068-88c5-3c7708c7e195_del complete
Apr 13 23:08:06 user nova-compute[71269]: INFO nova.compute.manager [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 23:08:06 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updated VIF entry in instance network info cache for port 7ae6b103-e1c6-42e6-9fcd-e76353955a76. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG nova.network.neutron [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating instance_info_cache with network_info: [{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3dba1400-d05e-41e4-80bf-03bd552f8277 req-50c03061-559a-441f-9826-c0b2a1428556 service nova] Releasing lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:06 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Took 0.85 seconds to deallocate network for instance.
Apr 13 23:08:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-70281f7c-7426-47c4-a407-f9098bdeb941 req-5144e55e-32db-46a1-85cc-09bb0c615a2e service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-deleted-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:07 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Deleted allocations for instance deb24b5e-f858-4068-88c5-3c7708c7e195
Apr 13 23:08:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8a2f76ec-bc53-4561-84d7-a2bcac09c365 tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Acquiring lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] Lock "deb24b5e-f858-4068-88c5-3c7708c7e195-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] No waiting events found dispatching network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:07 user nova-compute[71269]: WARNING nova.compute.manager [req-60ba6d89-9a35-4bf9-a11d-a55f5e56f4d8 req-3e447e25-e246-47d3-959a-c01b3142336e service nova] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Received unexpected event network-vif-plugged-c7f804a4-0e8d-4d99-a547-5c9252cb872c for instance with vm_state deleted and task_state None.
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.utils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ce01bd-514a-4367-b0ae-b7865c405b06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[30500d45-aa74-433e-a586-c1d1e2579ffe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ba870-a9ae-4b0e-9d24-58baff81edfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[723535f4-2f75-46b6-85b6-e8ff9075fca9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:08:09 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:08:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3556c0d4-e320-4a68-a780-b27c67cde8e8]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG os_brick.utils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:08:09 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating existing volume attachment record: 6c62ecca-ce70-4131-8d19-64c0940c99c6 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:08:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:08:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Creating image(s)
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Ensure instance console log exists: /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start _get_guest_xml network_info=[{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6c62ecca-ce70-4131-8d19-64c0940c99c6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9e9744c-04d3-486e-b032-90c672927962', 'attached_at': '', 'detached_at': '', 'volume_id': 'c92d2bbb-41da-4e9d-8f75-49194054cd70', 'serial': 'c92d2bbb-41da-4e9d-8f75-49194054cd70'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:08:14 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:14 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:08:14 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:08:14 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:08:14 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed9ac8-40b9-477e-85b0-b2b053b30c82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:08:14 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e66472-fb9e-4c2b-af8d-0fdb0d2e2fd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70] added
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb98bb9-7a70-47e4-b577-4ce8e1b6f658]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3065ee-dc87-4cdf-b9db-f07bde68b0a2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnklUCFX {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnklUCFX" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4a80ae-02f5-4e1b-ab1f-78776500af03]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnklUCFX'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5f364-d847-4ea6-993f-1f009ba73f2f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d7a98-bc2b-4289-aa43-0957270af07b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17393f44-7e9a-4d32-abea-883654f64cbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260]
Apr 13 23:08:14 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260] successful.
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b470c22-8215-430e-b264-142777d6c53f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a9f99-83fc-4c4a-8463-7f9849bbd606]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:08:14 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:08:14 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92385b6e-d67a-490a-8d87-cb4973ed5b51]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:08:14 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23163623630353863', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163623630353863', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874091226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874091226',id=35,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-4e758seo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:08:04Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=a9e9744c-04d3-486e-b032-90c672927962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:08:15 user nova-compute[71269]:   <uuid>a9e9744c-04d3-486e-b032-90c672927962</uuid>
Apr 13 23:08:15 user nova-compute[71269]:   <name>instance-00000023</name>
Apr 13 23:08:15 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:08:15 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:08:15 user nova-compute[71269]:   <metadata>
Apr 13 23:08:15 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:08:15 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-874091226</nova:name>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:08:14</nova:creationTime>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:08:15 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:08:15 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:owner>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 23:08:15 user nova-compute[71269]:       </nova:owner>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:08:15 user nova-compute[71269]:       <nova:ports>
Apr 13 23:08:15 user nova-compute[71269]:         <nova:port uuid="7ae6b103-e1c6-42e6-9fcd-e76353955a76">
Apr 13 23:08:15 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 23:08:15 user nova-compute[71269]:         </nova:port>
Apr 13 23:08:15 user nova-compute[71269]:       </nova:ports>
Apr 13 23:08:15 user nova-compute[71269]:     </nova:instance>
Apr 13 23:08:15 user nova-compute[71269]:   </metadata>
Apr 13 23:08:15 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:08:15 user nova-compute[71269]:     <system>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="serial">a9e9744c-04d3-486e-b032-90c672927962</entry>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="uuid">a9e9744c-04d3-486e-b032-90c672927962</entry>
Apr 13 23:08:15 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:08:15 user nova-compute[71269]:     </system>
Apr 13 23:08:15 user nova-compute[71269]:   </sysinfo>
Apr 13 23:08:15 user nova-compute[71269]:   <os>
Apr 13 23:08:15 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:08:15 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:08:15 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:08:15 user nova-compute[71269]:   </os>
Apr 13 23:08:15 user nova-compute[71269]:   <features>
Apr 13 23:08:15 user nova-compute[71269]:     <acpi/>
Apr 13 23:08:15 user nova-compute[71269]:     <apic/>
Apr 13 23:08:15 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:08:15 user nova-compute[71269]:   </features>
Apr 13 23:08:15 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:08:15 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:08:15 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:08:15 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:08:15 user nova-compute[71269]:   </clock>
Apr 13 23:08:15 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:08:15 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:08:15 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:08:15 user nova-compute[71269]:   </cpu>
Apr 13 23:08:15 user nova-compute[71269]:   <devices>
Apr 13 23:08:15 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:08:15 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:08:15 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 23:08:15 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:08:15 user nova-compute[71269]:       <serial>c92d2bbb-41da-4e9d-8f75-49194054cd70</serial>
Apr 13 23:08:15 user nova-compute[71269]:     </disk>
Apr 13 23:08:15 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:08:15 user nova-compute[71269]:       <mac address="fa:16:3e:af:76:cc"/>
Apr 13 23:08:15 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:08:15 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:08:15 user nova-compute[71269]:       <target dev="tap7ae6b103-e1"/>
Apr 13 23:08:15 user nova-compute[71269]:     </interface>
Apr 13 23:08:15 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:08:15 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/console.log" append="off"/>
Apr 13 23:08:15 user nova-compute[71269]:     </serial>
Apr 13 23:08:15 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:08:15 user nova-compute[71269]:     <video>
Apr 13 23:08:15 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:08:15 user nova-compute[71269]:     </video>
Apr 13 23:08:15 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:08:15 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:08:15 user nova-compute[71269]:     </rng>
Apr 13 23:08:15 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:08:15 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:08:15 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:08:15 user nova-compute[71269]:     </memballoon>
Apr 13 23:08:15 user nova-compute[71269]:   </devices>
Apr 13 23:08:15 user nova-compute[71269]: </domain>
Apr 13 23:08:15 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874091226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874091226',id=35,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-4e758seo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:08:04Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=a9e9744c-04d3-486e-b032-90c672927962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG os_vif [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ae6b103-e1, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ae6b103-e1, col_values=(('external_ids', {'iface-id': '7ae6b103-e1c6-42e6-9fcd-e76353955a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:76:cc', 'vm-uuid': 'a9e9744c-04d3-486e-b032-90c672927962'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:15 user nova-compute[71269]: INFO os_vif [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1')
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:08:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:af:76:cc, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:08:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:17 user nova-compute[71269]: WARNING nova.compute.manager [req-8db1d6da-d98a-410c-814f-ce4a309a10cb req-28957d67-10b3-4381-b4a8-174177529aee service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state building and task_state spawning.
Apr 13 23:08:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427299.1540604, a9e9744c-04d3-486e-b032-90c672927962 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Resumed (Lifecycle Event)
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance spawned successfully.
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427299.155546, a9e9744c-04d3-486e-b032-90c672927962 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Started (Lifecycle Event)
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:19 user nova-compute[71269]: WARNING nova.compute.manager [req-57ea01ab-3c53-4e46-a996-685aba82dea0 req-f3e67b1f-9962-4ece-907a-a6b327201e53 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state building and task_state spawning.
Apr 13 23:08:19 user nova-compute[71269]: INFO nova.compute.manager [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Took 16.44 seconds to build instance.
Apr 13 23:08:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3688a63e-faef-449a-a323-976cdebb154e tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.541s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:20 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427285.9457657, deb24b5e-f858-4068-88c5-3c7708c7e195 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:08:20 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] VM Stopped (Lifecycle Event)
Apr 13 23:08:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3091ff4-cdba-43be-b530-f5a3d7601e20 None None] [instance: deb24b5e-f858-4068-88c5-3c7708c7e195] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:08:26 user nova-compute[71269]: INFO nova.compute.claims [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Claim successful on node user
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:08:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.policy [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:08:26 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Creating image(s)
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "/opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "/opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk 1073741824" returned: 0 in 0.050s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:26 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Successfully created port: b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Cannot resize image /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'migration_context' on Instance uuid d3dc82c4-502a-4ff9-a230-129269f5c0e6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Ensure instance console log exists: /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Successfully updated port: b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquired lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-changed-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Refreshing instance network info cache due to event network-changed-b572f64e-cfdf-4d37-8ac3-6776b86a2c23. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Acquiring lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Updating instance_info_cache with network_info: [{"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Releasing lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Instance network_info: |[{"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Acquired lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Refreshing network info cache for port b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Start _get_guest_xml network_info=[{"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:08:28 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:28 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-317150459',display_name='tempest-VolumesActionsTest-instance-317150459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-317150459',id=36,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-lbi2f9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:08:27Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d3dc82c4-502a-4ff9-a230-129269f5c0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'pci_devices' on Instance uuid d3dc82c4-502a-4ff9-a230-129269f5c0e6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:08:28 user nova-compute[71269]:   <uuid>d3dc82c4-502a-4ff9-a230-129269f5c0e6</uuid>
Apr 13 23:08:28 user nova-compute[71269]:   <name>instance-00000024</name>
Apr 13 23:08:28 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:08:28 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:08:28 user nova-compute[71269]:   <metadata>
Apr 13 23:08:28 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:08:28 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:name>tempest-VolumesActionsTest-instance-317150459</nova:name>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:08:28</nova:creationTime>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:08:28 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:08:28 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:owner>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:user uuid="8c235879bc444a819061c4bb4bf3441b">tempest-VolumesActionsTest-1756435814-project-member</nova:user>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:project uuid="c6455f36704e4b3088d8a9114b087fd3">tempest-VolumesActionsTest-1756435814</nova:project>
Apr 13 23:08:28 user nova-compute[71269]:       </nova:owner>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:08:28 user nova-compute[71269]:       <nova:ports>
Apr 13 23:08:28 user nova-compute[71269]:         <nova:port uuid="b572f64e-cfdf-4d37-8ac3-6776b86a2c23">
Apr 13 23:08:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 23:08:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:08:28 user nova-compute[71269]:       </nova:ports>
Apr 13 23:08:28 user nova-compute[71269]:     </nova:instance>
Apr 13 23:08:28 user nova-compute[71269]:   </metadata>
Apr 13 23:08:28 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:08:28 user nova-compute[71269]:     <system>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="serial">d3dc82c4-502a-4ff9-a230-129269f5c0e6</entry>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="uuid">d3dc82c4-502a-4ff9-a230-129269f5c0e6</entry>
Apr 13 23:08:28 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:08:28 user nova-compute[71269]:     </system>
Apr 13 23:08:28 user nova-compute[71269]:   </sysinfo>
Apr 13 23:08:28 user nova-compute[71269]:   <os>
Apr 13 23:08:28 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:08:28 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:08:28 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:08:28 user nova-compute[71269]:   </os>
Apr 13 23:08:28 user nova-compute[71269]:   <features>
Apr 13 23:08:28 user nova-compute[71269]:     <acpi/>
Apr 13 23:08:28 user nova-compute[71269]:     <apic/>
Apr 13 23:08:28 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:08:28 user nova-compute[71269]:   </features>
Apr 13 23:08:28 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:08:28 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:08:28 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:08:28 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:08:28 user nova-compute[71269]:   </clock>
Apr 13 23:08:28 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:08:28 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:08:28 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:08:28 user nova-compute[71269]:   </cpu>
Apr 13 23:08:28 user nova-compute[71269]:   <devices>
Apr 13 23:08:28 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:08:28 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:08:28 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk"/>
Apr 13 23:08:28 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:08:28 user nova-compute[71269]:     </disk>
Apr 13 23:08:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:08:28 user nova-compute[71269]:       <mac address="fa:16:3e:df:a3:13"/>
Apr 13 23:08:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:08:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:08:28 user nova-compute[71269]:       <target dev="tapb572f64e-cf"/>
Apr 13 23:08:28 user nova-compute[71269]:     </interface>
Apr 13 23:08:28 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:08:28 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/console.log" append="off"/>
Apr 13 23:08:28 user nova-compute[71269]:     </serial>
Apr 13 23:08:28 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:08:28 user nova-compute[71269]:     <video>
Apr 13 23:08:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:08:28 user nova-compute[71269]:     </video>
Apr 13 23:08:28 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:08:28 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:08:28 user nova-compute[71269]:     </rng>
Apr 13 23:08:28 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:08:28 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:08:28 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:08:28 user nova-compute[71269]:     </memballoon>
Apr 13 23:08:28 user nova-compute[71269]:   </devices>
Apr 13 23:08:28 user nova-compute[71269]: </domain>
Apr 13 23:08:28 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-317150459',display_name='tempest-VolumesActionsTest-instance-317150459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-317150459',id=36,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-lbi2f9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:08:27Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d3dc82c4-502a-4ff9-a230-129269f5c0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG os_vif [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb572f64e-cf, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb572f64e-cf, col_values=(('external_ids', {'iface-id': 'b572f64e-cfdf-4d37-8ac3-6776b86a2c23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:a3:13', 'vm-uuid': 'd3dc82c4-502a-4ff9-a230-129269f5c0e6'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:28 user nova-compute[71269]: INFO os_vif [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf')
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] No VIF found with MAC fa:16:3e:df:a3:13, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:08:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Updated VIF entry in instance network info cache for port b572f64e-cfdf-4d37-8ac3-6776b86a2c23. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:08:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Updating instance_info_cache with network_info: [{"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:08:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-dfbeb3c3-2e81-41cb-ab71-541e451705ed req-c1af3c45-0906-4494-946e-6fd26bbde6dd service nova] Releasing lock "refresh_cache-d3dc82c4-502a-4ff9-a230-129269f5c0e6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] No waiting events found dispatching network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:30 user nova-compute[71269]: WARNING nova.compute.manager [req-5f857946-c933-4602-99e6-366efec6b1a9 req-43624a34-8f1a-4bf7-a555-53d08e0194d1 service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received unexpected event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance with vm_state building and task_state spawning.
Apr 13 23:08:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] No waiting events found dispatching network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:08:32 user nova-compute[71269]: WARNING nova.compute.manager [req-d4a9780c-7eb7-47f8-9ace-dec160a69e9b req-c2f5b9aa-fd39-4fc4-8598-d537001f21ce service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received unexpected event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance with vm_state building and task_state spawning.
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427312.7277527, d3dc82c4-502a-4ff9-a230-129269f5c0e6 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:08:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] VM Resumed (Lifecycle Event)
Apr 13 23:08:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Instance spawned successfully.
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:08:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:08:32 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427312.7279067, d3dc82c4-502a-4ff9-a230-129269f5c0e6 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:08:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] VM Started (Lifecycle Event)
Apr 13 23:08:33 user nova-compute[71269]: INFO nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Took 6.36 seconds to spawn the instance on the hypervisor.
Apr 13 23:08:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:08:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:08:33 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:08:33 user nova-compute[71269]: INFO nova.compute.manager [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Took 7.23 seconds to build instance.
Apr 13 23:08:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d134ce4f-2469-4d29-bcd9-26137efe32fe tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.483s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:47 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:08:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:08:52 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:08:55 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:08:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:08:59 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:59 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=26.20382308959961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a83b839-7b5b-4004-94da-d196d18caf0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 392704a5-705a-43d0-bab8-801c7ef5b514 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a9e9744c-04d3-486e-b032-90c672927962 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:08:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:02 user nova-compute[71269]: INFO nova.compute.manager [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Terminating instance
Apr 13 23:09:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:09:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-e59f455e-dc04-489d-8f65-e53afac8d77e req-8b010792-1a2b-4c5e-9c5f-b10f0cac102a service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-unplugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Instance destroyed successfully.
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid ff417f05-3cfa-4274-a0d9-9145ce1e5f83 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1927376719',display_name='tempest-ServerRescueNegativeTestJSON-server-1927376719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1927376719',id=5,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:54:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-jsn1bir9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:54:56Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=ff417f05-3cfa-4274-a0d9-9145ce1e5f83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "address": "fa:16:3e:ae:e2:b2", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac600f3d-8b", "ovs_interfaceid": "ac600f3d-8b2c-4200-81dd-3d35843d3f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG os_vif [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac600f3d-8b, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:03 user nova-compute[71269]: INFO os_vif [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=ac600f3d-8b2c-4200-81dd-3d35843d3f28,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac600f3d-8b')
Apr 13 23:09:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Deleting instance files /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83_del
Apr 13 23:09:03 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Deletion of /opt/stack/data/nova/instances/ff417f05-3cfa-4274-a0d9-9145ce1e5f83_del complete
Apr 13 23:09:03 user nova-compute[71269]: INFO nova.compute.manager [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 13 23:09:03 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:09:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Took 0.52 seconds to deallocate network for instance.
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-784df969-87dd-4add-9df0-1dddbff4306f req-0f90f7f8-3e40-45fa-a053-6c4180ea9eae service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-deleted-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.compute.manager [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Terminating instance
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Deleted allocations for instance ff417f05-3cfa-4274-a0d9-9145ce1e5f83
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f031d8c4-3690-41f1-9a08-852ff5cfb3cf tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Instance destroyed successfully.
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.objects.instance [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lazy-loading 'resources' on Instance uuid 392704a5-705a-43d0-bab8-801c7ef5b514 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-109950942',display_name='tempest-VolumesActionsTest-instance-109950942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-109950942',id=32,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12ecbdf826b849bf995787ada9d4a673',ramdisk_id='',reservation_id='r-puf3s2wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1315360402',owner_user_name='tempest-VolumesActionsTest-1315360402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:07:14Z,user_data=None,user_id='1114619485574b9499b5384a9529003f',uuid=392704a5-705a-43d0-bab8-801c7ef5b514,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converting VIF {"id": "e6adbdf3-3dac-401e-a86f-51f53230f579", "address": "fa:16:3e:3a:41:f6", "network": {"id": "db154217-b933-4624-bf61-98baf1727c6c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1508692786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "12ecbdf826b849bf995787ada9d4a673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6adbdf3-3d", "ovs_interfaceid": "e6adbdf3-3dac-401e-a86f-51f53230f579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG os_vif [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6adbdf3-3d, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:04 user nova-compute[71269]: INFO os_vif [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:41:f6,bridge_name='br-int',has_traffic_filtering=True,id=e6adbdf3-3dac-401e-a86f-51f53230f579,network=Network(db154217-b933-4624-bf61-98baf1727c6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6adbdf3-3d')
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Deleting instance files /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514_del
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Deletion of /opt/stack/data/nova/instances/392704a5-705a-43d0-bab8-801c7ef5b514_del complete
Apr 13 23:09:04 user nova-compute[71269]: INFO nova.compute.manager [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 23:09:04 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:09:04 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Acquiring lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "ff417f05-3cfa-4274-a0d9-9145ce1e5f83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] No waiting events found dispatching network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:05 user nova-compute[71269]: WARNING nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Received unexpected event network-vif-plugged-ac600f3d-8b2c-4200-81dd-3d35843d3f28 for instance with vm_state deleted and task_state None.
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-unplugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] No waiting events found dispatching network-vif-unplugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-unplugged-e6adbdf3-3dac-401e-a86f-51f53230f579 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Acquiring lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] Lock "392704a5-705a-43d0-bab8-801c7ef5b514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] No waiting events found dispatching network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:05 user nova-compute[71269]: WARNING nova.compute.manager [req-9060cf40-0756-4576-a6e5-dcdd2534f8f9 req-2f98804e-1394-46e6-b31c-7dbb5b8cc5fd service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received unexpected event network-vif-plugged-e6adbdf3-3dac-401e-a86f-51f53230f579 for instance with vm_state active and task_state deleting.
Apr 13 23:09:05 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:05 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Took 0.78 seconds to deallocate network for instance.
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:06 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:09:06 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:09:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-85053978-c3fb-4c4a-bf48-d9c9828de49d req-6d0adf11-932e-4d49-baf3-0e6f03e9d1a3 service nova] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Received event network-vif-deleted-e6adbdf3-3dac-401e-a86f-51f53230f579 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:06 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Deleted allocations for instance 392704a5-705a-43d0-bab8-801c7ef5b514
Apr 13 23:09:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-da4426e3-a619-4d7f-956b-8f4550ed1ae2 tempest-VolumesActionsTest-1315360402 tempest-VolumesActionsTest-1315360402-project-member] Lock "392704a5-705a-43d0-bab8-801c7ef5b514" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-changed-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG nova.compute.manager [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Refreshing instance network info cache due to event network-changed-09cc0c17-bd49-4207-9de4-89178a1e681e. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Refreshing network info cache for port 09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updated VIF entry in instance network info cache for port 09cc0c17-bd49-4207-9de4-89178a1e681e. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ba2ba1e0-3aef-43d0-bc9a-3316f8c050cb req-cbfa82ce-953c-43e3-a293-5e6d4e66058a service nova] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_power_states {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid dc473fb8-e574-4e49-b860-3ae0066cc9b8 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 1a83b839-7b5b-4004-94da-d196d18caf0f {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid d3dc82c4-502a-4ff9-a230-129269f5c0e6 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "a9e9744c-04d3-486e-b032-90c672927962" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "a9e9744c-04d3-486e-b032-90c672927962" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing instance network info cache due to event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Acquiring lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Acquired lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:09:17 user nova-compute[71269]: DEBUG nova.network.neutron [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updated VIF entry in instance network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating instance_info_cache with network_info: [{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e57bbe6b-2a54-4452-9015-45d6bf189ee4 req-97670725-8fe2-42fe-a0b9-548d755a5b9d service nova] Releasing lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing instance network info cache due to event network-changed-e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Acquiring lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Acquired lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Refreshing network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427343.4959884, ff417f05-3cfa-4274-a0d9-9145ce1e5f83 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:09:18 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] VM Stopped (Lifecycle Event)
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ae14e927-fd75-47a1-bccc-9e1014bf8e5e None None] [instance: ff417f05-3cfa-4274-a0d9-9145ce1e5f83] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:18 user nova-compute[71269]: INFO nova.compute.manager [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Terminating instance
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updated VIF entry in instance network info cache for port e1ea4927-3d26-47cf-8db8-daa6fe358335. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating instance_info_cache with network_info: [{"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5ebf2129-27c9-4864-b2c5-b5027efc1f04 req-7a190291-f9f4-415c-957c-1276fdbdbbdd service nova] Releasing lock "refresh_cache-1a9f5f1f-cc46-4c3c-834d-daa002031ee3" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:09:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Instance destroyed successfully.
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.objects.instance [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803529970',display_name='tempest-TestVolumeBootPattern-server-803529970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803529970',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-5swkcffi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:07:38Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a9f5f1f-cc46-4c3c-834d-daa002031ee3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "address": "fa:16:3e:a1:e0:3e", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ea4927-3d", "ovs_interfaceid": "e1ea4927-3d26-47cf-8db8-daa6fe358335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_vif [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1ea4927-3d, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:09:19 user nova-compute[71269]: INFO os_vif [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:e0:3e,bridge_name='br-int',has_traffic_filtering=True,id=e1ea4927-3d26-47cf-8db8-daa6fe358335,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ea4927-3d')
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIaVjmkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:09:19 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a4ed5-e57f-4def-b273-b955fba097b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:09:19 user nova-compute[71269]: No targets found.
Apr 13 23:09:19 user nova-compute[71269]: iSNS:
Apr 13 23:09:19 user nova-compute[71269]: No targets found.
Apr 13 23:09:19 user nova-compute[71269]: STATIC:
Apr 13 23:09:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:09:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:09:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:09:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:09:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:09:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:09:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf
Apr 13 23:09:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:09:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:09:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:09:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:09:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:09:19 user nova-compute[71269]: FIRMWARE:
Apr 13 23:09:19 user nova-compute[71269]: No targets found.
Apr 13 23:09:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:09:19 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:09:19 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fe58d2-73ed-4b55-8fdc-1d1bb03d17c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88ea3d-79d5-4d24-a8b2-67a78fcdb25e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf (non-flash)
Apr 13 23:09:19 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:09:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb4fc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e546c8b-0bc5-4202-bf90-30a97fcbb359]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944b168-31a0-4272-b879-1f08e5bb0cf9]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0649e64-9863-4ebf-81a5-4df5e1e06e56]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaa01ec-5fef-4dbf-b540-25372360d3d7]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeba889-6cc2-43e3-95b4-cc943a1cd498]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[14403e51-56c8-4344-9792-24e14b4b2107]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260]
Apr 13 23:09:19 user nova-compute[71269]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf, portal: 172.16.0.220,3260] successful.
Apr 13 23:09:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04f9d7-64ee-4c58-ad0d-4e4cf60febaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beecdbc-dddd-43a3-b46e-0ecf7ed77b4a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (334ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:09:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Deleting instance files /opt/stack/data/nova/instances/1a9f5f1f-cc46-4c3c-834d-daa002031ee3_del
Apr 13 23:09:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Deletion of /opt/stack/data/nova/instances/1a9f5f1f-cc46-4c3c-834d-daa002031ee3_del complete
Apr 13 23:09:19 user nova-compute[71269]: INFO nova.compute.manager [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 23:09:19 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427344.894177, 392704a5-705a-43d0-bab8-801c7ef5b514 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:09:19 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] VM Stopped (Lifecycle Event)
Apr 13 23:09:19 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2cbed735-362d-44fa-aca0-f8798aad7355 None None] [instance: 392704a5-705a-43d0-bab8-801c7ef5b514] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:20 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Took 0.50 seconds to deallocate network for instance.
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-05b8ddb7-bee2-4171-b763-0b9c3dd34e98 req-728b3fe4-b24f-4e7d-a8b5-c13e0ff9df47 service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-deleted-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-unplugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] No waiting events found dispatching network-vif-unplugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-unplugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Acquiring lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] No waiting events found dispatching network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:20 user nova-compute[71269]: WARNING nova.compute.manager [req-802df950-70f8-4ebb-9941-eb25a066a1a7 req-c32e3727-9afd-4c5a-a012-eb0c2ac2dffc service nova] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Received unexpected event network-vif-plugged-e1ea4927-3d26-47cf-8db8-daa6fe358335 for instance with vm_state active and task_state deleting.
Apr 13 23:09:20 user nova-compute[71269]: INFO nova.compute.manager [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Took 0.76 seconds to detach 1 volumes for instance.
Apr 13 23:09:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:21 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:09:21 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:09:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:21 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance 1a9f5f1f-cc46-4c3c-834d-daa002031ee3
Apr 13 23:09:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-23373a13-6c94-423e-a703-749844ca287a tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a9f5f1f-cc46-4c3c-834d-daa002031ee3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:34 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427359.2870686, 1a9f5f1f-cc46-4c3c-834d-daa002031ee3 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:09:34 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] VM Stopped (Lifecycle Event)
Apr 13 23:09:34 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f2a07727-354b-46a7-9e3d-cba6f18b9d22 None None] [instance: 1a9f5f1f-cc46-4c3c-834d-daa002031ee3] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:09:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:53 user nova-compute[71269]: INFO nova.compute.manager [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Terminating instance
Apr 13 23:09:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-1ac4e638-0a46-44e9-b0ed-304a87fa27c1 req-893b11a7-6c33-49e8-bc6f-e6c4459819f4 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-unplugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:53 user nova-compute[71269]: INFO nova.compute.manager [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Rescuing
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:09:53 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Instance destroyed successfully.
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lazy-loading 'resources' on Instance uuid df12dd8d-ea02-4c59-804d-52ae1bd4a555 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:52:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442957850',display_name='tempest-ServerRescueNegativeTestJSON-server-1442957850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442957850',id=4,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b6a1fccc07f4f5a8f8f8617ae03955d',ramdisk_id='',reservation_id='r-40rn7keu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-258614246',owner_user_name='tempest-ServerRescueNegativeTestJSON-258614246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:59:39Z,user_data=None,user_id='28cb6d8d6e3d4ef7aa53bb17faf495c4',uuid=df12dd8d-ea02-4c59-804d-52ae1bd4a555,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converting VIF {"id": "6566345e-be68-4eb1-90de-e53780e7f8f9", "address": "fa:16:3e:05:19:3f", "network": {"id": "3586c352-7de6-4c50-a421-23f8709105d0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1237060345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b6a1fccc07f4f5a8f8f8617ae03955d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6566345e-be", "ovs_interfaceid": "6566345e-be68-4eb1-90de-e53780e7f8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG os_vif [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6566345e-be, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:09:54 user nova-compute[71269]: INFO os_vif [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:19:3f,bridge_name='br-int',has_traffic_filtering=True,id=6566345e-be68-4eb1-90de-e53780e7f8f9,network=Network(3586c352-7de6-4c50-a421-23f8709105d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6566345e-be')
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Deleting instance files /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555_del
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Deletion of /opt/stack/data/nova/instances/df12dd8d-ea02-4c59-804d-52ae1bd4a555_del complete
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.compute.manager [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 23:09:54 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating instance_info_cache with network_info: [{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-deleted-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.compute.manager [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Neutron deleted interface 6566345e-be68-4eb1-90de-e53780e7f8f9; detaching it from the instance and deleting it from the info cache
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.network.neutron [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:09:54 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Took 0.54 seconds to deallocate network for instance.
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-c136caf1-0068-4d4d-a485-2edaac1371d8 req-b91adb7a-5223-42f7-b6b2-97c31df2da92 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Detach interface failed, port_id=6566345e-be68-4eb1-90de-e53780e7f8f9, reason: Instance df12dd8d-ea02-4c59-804d-52ae1bd4a555 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:09:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance destroyed successfully.
Apr 13 23:09:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Attempting a stable device rescue
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71269) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 23:09:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Creating image(s)
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "66ba419dc26519768d5c83fd82fea7077722e380" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "66ba419dc26519768d5c83fd82fea7077722e380" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:09:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:09:56 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Deleted allocations for instance df12dd8d-ea02-4c59-804d-52ae1bd4a555
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Acquiring lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] No waiting events found dispatching network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:56 user nova-compute[71269]: WARNING nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Received unexpected event network-vif-plugged-6566345e-be68-4eb1-90de-e53780e7f8f9 for instance with vm_state deleted and task_state None.
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:56 user nova-compute[71269]: WARNING nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state active and task_state rescuing.
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:56 user nova-compute[71269]: WARNING nova.compute.manager [req-6b69c225-1928-4a42-abd2-c12ff2087d40 req-d325dafe-5374-43ae-a397-7620b185df67 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state active and task_state rescuing.
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2de8e497-d359-4298-8a0b-74316424a1bc tempest-ServerRescueNegativeTestJSON-258614246 tempest-ServerRescueNegativeTestJSON-258614246-project-member] Lock "df12dd8d-ea02-4c59-804d-52ae1bd4a555" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.763s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.virt.images [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] 0d358831-cd5e-4bbe-98f2-c0c289b7851e was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.part /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.part /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.converted" returned: 0 in 0.377s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "66ba419dc26519768d5c83fd82fea7077722e380" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "66ba419dc26519768d5c83fd82fea7077722e380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "66ba419dc26519768d5c83fd82fea7077722e380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380 --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:56 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380,backing_fmt=raw /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380,backing_fmt=raw /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue" returned: 0 in 0.188s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "66ba419dc26519768d5c83fd82fea7077722e380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'migration_context' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start _get_guest_xml network_info=[{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:af:76:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d358831-cd5e-4bbe-98f2-c0c289b7851e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6c62ecca-ce70-4131-8d19-64c0940c99c6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a9e9744c-04d3-486e-b032-90c672927962', 'attached_at': '', 'detached_at': '', 'volume_id': 'c92d2bbb-41da-4e9d-8f75-49194054cd70', 'serial': 'c92d2bbb-41da-4e9d-8f75-49194054cd70'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'numa_topology' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:09:57 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:09:57 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:09:57 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:09:57 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf3507-8ab4-409b-b7ed-2d0a5b62aab3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BnklUCFX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 23:09:57 user nova-compute[71269]: node.name = iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:09:57 user nova-compute[71269]: node.tpgt = -1
Apr 13 23:09:57 user nova-compute[71269]: node.startup = automatic
Apr 13 23:09:57 user nova-compute[71269]: node.leading_login = No
Apr 13 23:09:57 user nova-compute[71269]: iface.iscsi_ifacename = default
Apr 13 23:09:57 user nova-compute[71269]: iface.net_ifacename = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.ipaddress = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.prefix_len = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.hwaddress = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.transport_name = tcp
Apr 13 23:09:57 user nova-compute[71269]: iface.initiatorname = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.vlan_id = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.vlan_priority = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.vlan_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.iface_num = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.mtu = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.port = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.bootproto = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.subnet_mask = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.gateway = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_alt_client_id = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_dns = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_learn_iqn = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_vendor_id_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_vendor_id = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.dhcp_slp_da = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.fragmentation = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.gratuitous_arp = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.incoming_forwarding = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.tos_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.tos = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.ttl = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.delayed_ack = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.tcp_nagle = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.tcp_wsf_state = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.tcp_wsf = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.tcp_timer_scale = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.tcp_timestamp = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.redirect = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.def_task_mgmt_timeout = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.header_digest = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.data_digest = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.immediate_data = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.initial_r2t = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.data_seq_inorder = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.data_pdu_inorder = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.erl = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.max_receive_data_len = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.first_burst_len = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.max_outstanding_r2t = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.max_burst_len = 0
Apr 13 23:09:57 user nova-compute[71269]: iface.chap_auth = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.bidi_chap = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.strict_login_compliance = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.discovery_auth = <empty>
Apr 13 23:09:57 user nova-compute[71269]: iface.discovery_logout = <empty>
Apr 13 23:09:57 user nova-compute[71269]: node.discovery_address = <empty>
Apr 13 23:09:57 user nova-compute[71269]: node.discovery_port = 0
Apr 13 23:09:57 user nova-compute[71269]: node.discovery_type = static
Apr 13 23:09:57 user nova-compute[71269]: node.session.initial_cmdsn = 0
Apr 13 23:09:57 user nova-compute[71269]: node.session.initial_login_retry_max = 8
Apr 13 23:09:57 user nova-compute[71269]: node.session.xmit_thread_priority = -20
Apr 13 23:09:57 user nova-compute[71269]: node.session.cmds_max = 128
Apr 13 23:09:57 user nova-compute[71269]: node.session.queue_depth = 32
Apr 13 23:09:57 user nova-compute[71269]: node.session.nr_sessions = 1
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.authmethod = CHAP
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.username = BnklUCFX
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.password = ***
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.username_in = <empty>
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.password_in = <empty>
Apr 13 23:09:57 user nova-compute[71269]: node.session.auth.chap_algs = MD5
Apr 13 23:09:57 user nova-compute[71269]: node.session.timeo.replacement_timeout = 120
Apr 13 23:09:57 user nova-compute[71269]: node.session.err_timeo.abort_timeout = 15
Apr 13 23:09:57 user nova-compute[71269]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 23:09:57 user nova-compute[71269]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 23:09:57 user nova-compute[71269]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.FastAbort = Yes
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.InitialR2T = No
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.ImmediateData = Yes
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.MaxConnections = 1
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 23:09:57 user nova-compute[71269]: node.session.iscsi.ERL = 0
Apr 13 23:09:57 user nova-compute[71269]: node.session.scan = manual
Apr 13 23:09:57 user nova-compute[71269]: node.session.reopen_max = 0
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].address = 172.16.0.220
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].port = 3260
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].startup = manual
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].tcp.window_size = 524288
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].tcp.type_of_service = 0
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].timeo.logout_timeout = 15
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].timeo.login_timeout = 15
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].timeo.auth_timeout = 45
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.DataDigest = None
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.IFMarker = No
Apr 13 23:09:57 user nova-compute[71269]: node.conn[0].iscsi.OFMarker = No
Apr 13 23:09:57 user nova-compute[71269]: # END RECORD
Apr 13 23:09:57 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eadf0d-dc1b-4339-a86c-3a0037107753]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b1cd5-003e-450e-82a7-bfca41a1b209]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnklUCFX {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnklUCFX" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea781bc-45c6-4136-95a5-72d2c7dbbf06]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnklUCFX'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7fe745-6a44-46b6-a563-804afbd3d239]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc0d187-34f7-4873-951d-4b4c36fcc281]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:09:57 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.209s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[285bc089-ec08-425a-9251-b1bef0bdc0d2]: (4, ('0 0 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.235s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== connect_volume: return (237ms) {'type': 'block', 'scsi_wwn': '23163623630353863', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163623630353863', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874091226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874091226',id=35,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-4e758seo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:08:19Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=a9e9744c-04d3-486e-b032-90c672927962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:af:76:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "vif_mac": "fa:16:3e:af:76:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'pci_devices' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:09:57 user nova-compute[71269]:   <uuid>a9e9744c-04d3-486e-b032-90c672927962</uuid>
Apr 13 23:09:57 user nova-compute[71269]:   <name>instance-00000023</name>
Apr 13 23:09:57 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:09:57 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:09:57 user nova-compute[71269]:   <metadata>
Apr 13 23:09:57 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:09:57 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-874091226</nova:name>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:09:57</nova:creationTime>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:09:57 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:09:57 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:owner>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:user uuid="6db44e7cb89a46c2999916b0a266b159">tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member</nova:user>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:project uuid="3fe77a2c491c4596ba7e6af3236d7de8">tempest-ServerBootFromVolumeStableRescueTest-1416841836</nova:project>
Apr 13 23:09:57 user nova-compute[71269]:       </nova:owner>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:09:57 user nova-compute[71269]:       <nova:ports>
Apr 13 23:09:57 user nova-compute[71269]:         <nova:port uuid="7ae6b103-e1c6-42e6-9fcd-e76353955a76">
Apr 13 23:09:57 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 23:09:57 user nova-compute[71269]:         </nova:port>
Apr 13 23:09:57 user nova-compute[71269]:       </nova:ports>
Apr 13 23:09:57 user nova-compute[71269]:     </nova:instance>
Apr 13 23:09:57 user nova-compute[71269]:   </metadata>
Apr 13 23:09:57 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:09:57 user nova-compute[71269]:     <system>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="serial">a9e9744c-04d3-486e-b032-90c672927962</entry>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="uuid">a9e9744c-04d3-486e-b032-90c672927962</entry>
Apr 13 23:09:57 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:09:57 user nova-compute[71269]:     </system>
Apr 13 23:09:57 user nova-compute[71269]:   </sysinfo>
Apr 13 23:09:57 user nova-compute[71269]:   <os>
Apr 13 23:09:57 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:09:57 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:09:57 user nova-compute[71269]:   </os>
Apr 13 23:09:57 user nova-compute[71269]:   <features>
Apr 13 23:09:57 user nova-compute[71269]:     <acpi/>
Apr 13 23:09:57 user nova-compute[71269]:     <apic/>
Apr 13 23:09:57 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:09:57 user nova-compute[71269]:   </features>
Apr 13 23:09:57 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:09:57 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:09:57 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:09:57 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:09:57 user nova-compute[71269]:   </clock>
Apr 13 23:09:57 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:09:57 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:09:57 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:09:57 user nova-compute[71269]:   </cpu>
Apr 13 23:09:57 user nova-compute[71269]:   <devices>
Apr 13 23:09:57 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:09:57 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:09:57 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 23:09:57 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:09:57 user nova-compute[71269]:       <serial>c92d2bbb-41da-4e9d-8f75-49194054cd70</serial>
Apr 13 23:09:57 user nova-compute[71269]:     </disk>
Apr 13 23:09:57 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:09:57 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:09:57 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue"/>
Apr 13 23:09:57 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:09:57 user nova-compute[71269]:       <boot order="1"/>
Apr 13 23:09:57 user nova-compute[71269]:     </disk>
Apr 13 23:09:57 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:09:57 user nova-compute[71269]:       <mac address="fa:16:3e:af:76:cc"/>
Apr 13 23:09:57 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:09:57 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:09:57 user nova-compute[71269]:       <target dev="tap7ae6b103-e1"/>
Apr 13 23:09:57 user nova-compute[71269]:     </interface>
Apr 13 23:09:57 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:09:57 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/console.log" append="off"/>
Apr 13 23:09:57 user nova-compute[71269]:     </serial>
Apr 13 23:09:57 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:09:57 user nova-compute[71269]:     <video>
Apr 13 23:09:57 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:09:57 user nova-compute[71269]:     </video>
Apr 13 23:09:57 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:09:57 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:09:57 user nova-compute[71269]:     </rng>
Apr 13 23:09:57 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:09:57 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:09:57 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:09:57 user nova-compute[71269]:     </memballoon>
Apr 13 23:09:57 user nova-compute[71269]:   </devices>
Apr 13 23:09:57 user nova-compute[71269]: </domain>
Apr 13 23:09:57 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:09:57 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance destroyed successfully.
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] No VIF found with MAC fa:16:3e:af:76:cc, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:09:57 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG nova.compute.manager [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:09:59 user nova-compute[71269]: WARNING nova.compute.manager [req-445b2ff5-b2c3-4fe9-86a6-c46f652aa716 req-c8a3db27-6ef7-4155-ab19-69b3f676630e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state active and task_state rescuing.
Apr 13 23:09:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:09:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:01 user nova-compute[71269]: WARNING nova.compute.manager [req-3c081963-9065-4a63-a574-d3e5f8a5d9a1 req-782a532d-1653-4e96-a7c0-7722641f278e service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state active and task_state rescuing.
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for a9e9744c-04d3-486e-b032-90c672927962 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427401.3002188, a9e9744c-04d3-486e-b032-90c672927962 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:01 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Resumed (Lifecycle Event)
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5f0ed0f6-0da3-423e-8154-78711e6894e4 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:01 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:10:01 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8103MB free_disk=26.19870376586914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:10:01 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427401.3017232, a9e9744c-04d3-486e-b032-90c672927962 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:01 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Started (Lifecycle Event)
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 1a83b839-7b5b-4004-94da-d196d18caf0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a9e9744c-04d3-486e-b032-90c672927962 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:10:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:10:02 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:10:02 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:10:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:10:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:10:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:09 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427394.2393556, df12dd8d-ea02-4c59-804d-52ae1bd4a555 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:09 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] VM Stopped (Lifecycle Event)
Apr 13 23:10:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9b64aaa9-aea4-44e7-b394-fe9fcc46d7a7 None None] [instance: df12dd8d-ea02-4c59-804d-52ae1bd4a555] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:16 user nova-compute[71269]: INFO nova.compute.manager [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Terminating instance
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing instance network info cache due to event network-changed-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Acquiring lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Acquired lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Refreshing network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:16 user nova-compute[71269]: INFO nova.compute.manager [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Terminating instance
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updated VIF entry in instance network info cache for port a88bc4ee-b024-4d26-9e56-e60daf6ef5fa. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG nova.network.neutron [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating instance_info_cache with network_info: [{"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39839dde-39e3-49a9-9abc-92dfb97f2224 req-dafde1d5-5271-4e8b-80d2-877006685053 service nova] Releasing lock "refresh_cache-1a83b839-7b5b-4004-94da-d196d18caf0f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Instance destroyed successfully.
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'resources' on Instance uuid d3dc82c4-502a-4ff9-a230-129269f5c0e6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Instance destroyed successfully.
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lazy-loading 'resources' on Instance uuid 1a83b839-7b5b-4004-94da-d196d18caf0f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-317150459',display_name='tempest-VolumesActionsTest-instance-317150459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-317150459',id=36,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-lbi2f9wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:08:33Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d3dc82c4-502a-4ff9-a230-129269f5c0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "address": "fa:16:3e:df:a3:13", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb572f64e-cf", "ovs_interfaceid": "b572f64e-cfdf-4d37-8ac3-6776b86a2c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_vif [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb572f64e-cf, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876646587',display_name='tempest-TestVolumeBootPattern-server-876646587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876646587',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8CZA5RghKz7K8Y+9yZj2ETI4xi2zuLToUWaLxjWoaX6IAWaiUhjHsm0FDZwmMUQXZa4WFnJ4hfzQyNTjxOtNUh6s5QP9ZWSYC8B80ZF366UkoREr402Yb3H4RlLm3SjQ==',key_name='tempest-TestVolumeBootPattern-408481084',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:05:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d872848d5dc1471996e2f33bbbdebbd9',ramdisk_id='',reservation_id='r-rmk6pnk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-751187467',owner_user_name='tempest-TestVolumeBootPattern-751187467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:05:37Z,user_data=None,user_id='b289294050af4c41aeef8401832487a1',uuid=1a83b839-7b5b-4004-94da-d196d18caf0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converting VIF {"id": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "address": "fa:16:3e:56:ea:3b", "network": {"id": "aadb940e-808f-4d62-87fe-765d072b7c2f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1270810937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d872848d5dc1471996e2f33bbbdebbd9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88bc4ee-b0", "ovs_interfaceid": "a88bc4ee-b024-4d26-9e56-e60daf6ef5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_vif [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88bc4ee-b0, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:10:17 user nova-compute[71269]: INFO os_vif [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a3:13,bridge_name='br-int',has_traffic_filtering=True,id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb572f64e-cf')
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Deleting instance files /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6_del
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Deletion of /opt/stack/data/nova/instances/d3dc82c4-502a-4ff9-a230-129269f5c0e6_del complete
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:10:17 user nova-compute[71269]: INFO os_vif [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ea:3b,bridge_name='br-int',has_traffic_filtering=True,id=a88bc4ee-b024-4d26-9e56-e60daf6ef5fa,network=Network(aadb940e-808f-4d62-87fe-765d072b7c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88bc4ee-b0')
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgIkJYPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:10:17 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e90b49-eed3-4d8c-a123-97dda5c804a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:10:17 user nova-compute[71269]: No targets found.
Apr 13 23:10:17 user nova-compute[71269]: iSNS:
Apr 13 23:10:17 user nova-compute[71269]: No targets found.
Apr 13 23:10:17 user nova-compute[71269]: STATIC:
Apr 13 23:10:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:10:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:10:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:10:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:10:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:10:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:10:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990
Apr 13 23:10:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:10:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:10:17 user nova-compute[71269]: FIRMWARE:
Apr 13 23:10:17 user nova-compute[71269]: No targets found.
Apr 13 23:10:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:10:17 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:10:17 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dca3c-f13c-44ad-bd83-216bac6f5ff5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.compute.manager [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb1434e-5715-4aa0-9893-0e5ee38518d8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:10:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2b4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990'): ({'sdj'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Removing single pathed devices sdj {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c158c52-eca9-44ba-b445-2d60f2ce6e7d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860fb59-3247-471a-9e61-c3b551b49312]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Flushing IO for device /dev/sdj {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821aae8-cda9-4548-8640-9cccab6b664f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66dc1e9-ef2a-44ff-9176-928186446db3]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] SCSI volumes sdj have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[99495898-6113-44dc-ad11-447465e5acf6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b119a7-4b11-417f-98a2-fd726eb13f39]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260]
Apr 13 23:10:17 user nova-compute[71269]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990, portal: 172.16.0.220,3260] successful.
Apr 13 23:10:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e14d684-74a4-43e0-aa03-5dc4d626d990 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a42d6c-c22c-4092-9024-cfe27dd56c4f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] <== disconnect_volume: return (441ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Deleting instance files /opt/stack/data/nova/instances/1a83b839-7b5b-4004-94da-d196d18caf0f_del
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Deletion of /opt/stack/data/nova/instances/1a83b839-7b5b-4004-94da-d196d18caf0f_del complete
Apr 13 23:10:17 user nova-compute[71269]: INFO nova.compute.manager [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Took 1.63 seconds to destroy the instance on the hypervisor.
Apr 13 23:10:17 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-unplugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] No waiting events found dispatching network-vif-unplugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-unplugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] No waiting events found dispatching network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: WARNING nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received unexpected event network-vif-plugged-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 for instance with vm_state active and task_state deleting.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: WARNING nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state active and task_state deleting.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: WARNING nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state active and task_state deleting.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: WARNING nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state active and task_state deleting.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-3ebf0e2a-8f11-4eb9-a0da-494e29557ba2 req-d9938b12-1274-4339-b720-cab07a1da1bf service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-unplugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Received event network-vif-deleted-b572f64e-cfdf-4d37-8ac3-6776b86a2c23 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:18 user nova-compute[71269]: INFO nova.compute.manager [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Neutron deleted interface b572f64e-cfdf-4d37-8ac3-6776b86a2c23; detaching it from the instance and deleting it from the info cache
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:18 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Took 0.82 seconds to deallocate network for instance.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-796324d7-5824-46ca-9db1-54337cf5d84e req-e914db75-e35c-4e3c-933d-d2d43ecde30e service nova] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Detach interface failed, port_id=b572f64e-cfdf-4d37-8ac3-6776b86a2c23, reason: Instance d3dc82c4-502a-4ff9-a230-129269f5c0e6 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:18 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Took 0.61 seconds to deallocate network for instance.
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Deleted allocations for instance d3dc82c4-502a-4ff9-a230-129269f5c0e6
Apr 13 23:10:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d718aeb-9e1c-4495-8cbe-ab9107a29882 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d3dc82c4-502a-4ff9-a230-129269f5c0e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.673s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:19 user nova-compute[71269]: INFO nova.compute.manager [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 23:10:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:19 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:10:19 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:10:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:19 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Deleted allocations for instance 1a83b839-7b5b-4004-94da-d196d18caf0f
Apr 13 23:10:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b01be498-ce82-402d-a266-522f55235501 tempest-TestVolumeBootPattern-751187467 tempest-TestVolumeBootPattern-751187467-project-member] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.490s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Acquiring lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] Lock "1a83b839-7b5b-4004-94da-d196d18caf0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] No waiting events found dispatching network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:20 user nova-compute[71269]: WARNING nova.compute.manager [req-10099b3e-30dc-4fcb-b6c3-85307c135344 req-26787509-1088-4bc2-9976-3435f2a52740 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received unexpected event network-vif-plugged-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa for instance with vm_state deleted and task_state None.
Apr 13 23:10:20 user nova-compute[71269]: DEBUG nova.compute.manager [req-c9f91f1d-3aaf-4456-b49b-58ce0d4b6f64 req-13834b6a-437d-459c-9c5e-7ad6b4bbecd3 service nova] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Received event network-vif-deleted-a88bc4ee-b024-4d26-9e56-e60daf6ef5fa {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:32 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427417.2965686, d3dc82c4-502a-4ff9-a230-129269f5c0e6 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:32 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] VM Stopped (Lifecycle Event)
Apr 13 23:10:32 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427417.2974653, 1a83b839-7b5b-4004-94da-d196d18caf0f => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:32 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] VM Stopped (Lifecycle Event)
Apr 13 23:10:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36c70b9d-0408-4055-8a65-5c8717552e6f None None] [instance: d3dc82c4-502a-4ff9-a230-129269f5c0e6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-07767ce5-63d5-4285-b7e2-fbc7e8de02b9 None None] [instance: 1a83b839-7b5b-4004-94da-d196d18caf0f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:48 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:10:48 user nova-compute[71269]: INFO nova.compute.claims [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Claim successful on node user
Apr 13 23:10:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:10:49 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.policy [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2a6385ae82042ad9682f7728b8263da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f4ef55afe342ebb945ad336e01582a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:10:49 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Creating image(s)
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "/opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "/opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk 1073741824" returned: 0 in 0.051s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Cannot resize image /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:10:49 user nova-compute[71269]: DEBUG nova.objects.instance [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'migration_context' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Ensure instance console log exists: /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:50 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Successfully created port: 16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Successfully updated port: 16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing instance network info cache due to event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.neutron [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Instance network_info: |[{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.neutron [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Start _get_guest_xml network_info=[{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:10:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:10:51 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1645185487',display_name='tempest-SnapshotDataIntegrityTests-server-1645185487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1645185487',id=37,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbB6sa0qGoo1uWEnwUaJj9s1UuIKgrOwtILphdBtTQizKy9xpM5DtQrXIJG+9yp8i8o8V+z8fU91AFXEqYnHagF++bPRquFDt0mPaYitTF7YiPTAyUmr8TXVZldj1JB0Q==',key_name='tempest-SnapshotDataIntegrityTests-1668706765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f4ef55afe342ebb945ad336e01582a',ramdisk_id='',reservation_id='r-ql7l2eat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1787800466',owner_user_name='tempest-SnapshotDataIntegrityTests-1787800466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:10:49Z,user_data=None,user_id='d2a6385ae82042ad9682f7728b8263da',uuid=9de39303-da44-47ae-adef-ff80f0b792a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converting VIF {"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:10:51 user nova-compute[71269]:   <uuid>9de39303-da44-47ae-adef-ff80f0b792a7</uuid>
Apr 13 23:10:51 user nova-compute[71269]:   <name>instance-00000025</name>
Apr 13 23:10:51 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:10:51 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:10:51 user nova-compute[71269]:   <metadata>
Apr 13 23:10:51 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:10:51 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1645185487</nova:name>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:10:51</nova:creationTime>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:10:51 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:10:51 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:owner>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:user uuid="d2a6385ae82042ad9682f7728b8263da">tempest-SnapshotDataIntegrityTests-1787800466-project-member</nova:user>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:project uuid="59f4ef55afe342ebb945ad336e01582a">tempest-SnapshotDataIntegrityTests-1787800466</nova:project>
Apr 13 23:10:51 user nova-compute[71269]:       </nova:owner>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:10:51 user nova-compute[71269]:       <nova:ports>
Apr 13 23:10:51 user nova-compute[71269]:         <nova:port uuid="16379ba5-9e41-4846-9ac8-8b5e86b776c0">
Apr 13 23:10:51 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:10:51 user nova-compute[71269]:         </nova:port>
Apr 13 23:10:51 user nova-compute[71269]:       </nova:ports>
Apr 13 23:10:51 user nova-compute[71269]:     </nova:instance>
Apr 13 23:10:51 user nova-compute[71269]:   </metadata>
Apr 13 23:10:51 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:10:51 user nova-compute[71269]:     <system>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="serial">9de39303-da44-47ae-adef-ff80f0b792a7</entry>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="uuid">9de39303-da44-47ae-adef-ff80f0b792a7</entry>
Apr 13 23:10:51 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:10:51 user nova-compute[71269]:     </system>
Apr 13 23:10:51 user nova-compute[71269]:   </sysinfo>
Apr 13 23:10:51 user nova-compute[71269]:   <os>
Apr 13 23:10:51 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:10:51 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:10:51 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:10:51 user nova-compute[71269]:   </os>
Apr 13 23:10:51 user nova-compute[71269]:   <features>
Apr 13 23:10:51 user nova-compute[71269]:     <acpi/>
Apr 13 23:10:51 user nova-compute[71269]:     <apic/>
Apr 13 23:10:51 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:10:51 user nova-compute[71269]:   </features>
Apr 13 23:10:51 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:10:51 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:10:51 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:10:51 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:10:51 user nova-compute[71269]:   </clock>
Apr 13 23:10:51 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:10:51 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:10:51 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:10:51 user nova-compute[71269]:   </cpu>
Apr 13 23:10:51 user nova-compute[71269]:   <devices>
Apr 13 23:10:51 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:10:51 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:10:51 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk"/>
Apr 13 23:10:51 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:10:51 user nova-compute[71269]:     </disk>
Apr 13 23:10:51 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:10:51 user nova-compute[71269]:       <mac address="fa:16:3e:80:4c:a0"/>
Apr 13 23:10:51 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:10:51 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:10:51 user nova-compute[71269]:       <target dev="tap16379ba5-9e"/>
Apr 13 23:10:51 user nova-compute[71269]:     </interface>
Apr 13 23:10:51 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:10:51 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/console.log" append="off"/>
Apr 13 23:10:51 user nova-compute[71269]:     </serial>
Apr 13 23:10:51 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:10:51 user nova-compute[71269]:     <video>
Apr 13 23:10:51 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:10:51 user nova-compute[71269]:     </video>
Apr 13 23:10:51 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:10:51 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:10:51 user nova-compute[71269]:     </rng>
Apr 13 23:10:51 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:10:51 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:10:51 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:10:51 user nova-compute[71269]:     </memballoon>
Apr 13 23:10:51 user nova-compute[71269]:   </devices>
Apr 13 23:10:51 user nova-compute[71269]: </domain>
Apr 13 23:10:51 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1645185487',display_name='tempest-SnapshotDataIntegrityTests-server-1645185487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1645185487',id=37,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbB6sa0qGoo1uWEnwUaJj9s1UuIKgrOwtILphdBtTQizKy9xpM5DtQrXIJG+9yp8i8o8V+z8fU91AFXEqYnHagF++bPRquFDt0mPaYitTF7YiPTAyUmr8TXVZldj1JB0Q==',key_name='tempest-SnapshotDataIntegrityTests-1668706765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f4ef55afe342ebb945ad336e01582a',ramdisk_id='',reservation_id='r-ql7l2eat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1787800466',owner_user_name='tempest-SnapshotDataIntegrityTests-1787800466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:10:49Z,user_data=None,user_id='d2a6385ae82042ad9682f7728b8263da',uuid=9de39303-da44-47ae-adef-ff80f0b792a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converting VIF {"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG os_vif [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16379ba5-9e, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16379ba5-9e, col_values=(('external_ids', {'iface-id': '16379ba5-9e41-4846-9ac8-8b5e86b776c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:4c:a0', 'vm-uuid': '9de39303-da44-47ae-adef-ff80f0b792a7'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:51 user nova-compute[71269]: INFO os_vif [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e')
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:10:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No VIF found with MAC fa:16:3e:80:4c:a0, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:10:52 user nova-compute[71269]: DEBUG nova.network.neutron [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updated VIF entry in instance network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:10:52 user nova-compute[71269]: DEBUG nova.network.neutron [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:10:52 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-af98b6ac-6542-4091-9d3f-9c98abcf689b req-58b042cc-8cd2-428e-bac5-da36673dd35b service nova] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] No waiting events found dispatching network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:53 user nova-compute[71269]: WARNING nova.compute.manager [req-5341d9ff-03e0-48d1-aef3-97fa0d3855e4 req-6da2dd06-4e54-40d8-8c22-58eef0704bcb service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received unexpected event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance with vm_state building and task_state spawning.
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427455.382906, 9de39303-da44-47ae-adef-ff80f0b792a7 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] VM Resumed (Lifecycle Event)
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Instance spawned successfully.
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427455.388169, 9de39303-da44-47ae-adef-ff80f0b792a7 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] VM Started (Lifecycle Event)
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:10:55 user nova-compute[71269]: INFO nova.compute.manager [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Took 6.85 seconds to build instance.
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] No waiting events found dispatching network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:10:55 user nova-compute[71269]: WARNING nova.compute.manager [req-b0b5b5e9-6007-4105-8b7f-616d55b53cf2 req-9f90c746-1181-4367-8c9c-191d52cf819e service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received unexpected event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance with vm_state active and task_state None.
Apr 13 23:10:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-78c11e35-2e5b-4d4b-9766-ef6ef8ccfe16 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.949s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:56 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:57 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:10:59 user nova-compute[71269]: INFO nova.compute.manager [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Terminating instance
Apr 13 23:10:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:10:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-80dbab4e-ca89-4081-b20e-5f0df981bdba req-0c592591-96cf-4662-b624-3b9ac0e265b1 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:11:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Instance destroyed successfully.
Apr 13 23:11:00 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:00 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8129MB free_disk=26.20594024658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.objects.instance [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lazy-loading 'resources' on Instance uuid dc473fb8-e574-4e49-b860-3ae0066cc9b8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-18447064',display_name='tempest-ServersNegativeTestJSON-server-18447064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-18447064',id=23,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:02:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8a3c684b0414336b2ca770eb1f3ab17',ramdisk_id='',reservation_id='r-hffexq0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1433854176',owner_user_name='tempest-ServersNegativeTestJSON-1433854176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:02:21Z,user_data=None,user_id='71593deacbd74fea9fc2faf5a9b08877',uuid=dc473fb8-e574-4e49-b860-3ae0066cc9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converting VIF {"id": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "address": "fa:16:3e:d8:8e:16", "network": {"id": "767f78e8-a875-44f4-bb0d-64565b88a59d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-518230460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8a3c684b0414336b2ca770eb1f3ab17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e91af8-5b", "ovs_interfaceid": "29e91af8-5b8e-4872-9ee0-9cc4b79fb647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG os_vif [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29e91af8-5b, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:11:00 user nova-compute[71269]: INFO os_vif [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647,network=Network(767f78e8-a875-44f4-bb0d-64565b88a59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e91af8-5b')
Apr 13 23:11:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Deleting instance files /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8_del
Apr 13 23:11:00 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Deletion of /opt/stack/data/nova/instances/dc473fb8-e574-4e49-b860-3ae0066cc9b8_del complete
Apr 13 23:11:01 user nova-compute[71269]: INFO nova.compute.manager [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 13 23:11:01 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a9e9744c-04d3-486e-b032-90c672927962 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-deleted-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:01 user nova-compute[71269]: INFO nova.compute.manager [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Neutron deleted interface 29e91af8-5b8e-4872-9ee0-9cc4b79fb647; detaching it from the instance and deleting it from the info cache
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.network.neutron [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:01 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Took 0.74 seconds to deallocate network for instance.
Apr 13 23:11:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-dd59239c-b408-420a-91ba-b2eab49b42d7 req-ca5cccdd-9379-4ff1-b978-0b7f41eaeb63 service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Detach interface failed, port_id=29e91af8-5b8e-4872-9ee0-9cc4b79fb647, reason: Instance dc473fb8-e574-4e49-b860-3ae0066cc9b8 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Deleted allocations for instance dc473fb8-e574-4e49-b860-3ae0066cc9b8
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-41a80052-696a-41e8-ae8e-99ca5a1f2ce3 tempest-ServersNegativeTestJSON-1433854176 tempest-ServersNegativeTestJSON-1433854176-project-member] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:02 user nova-compute[71269]: WARNING nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state deleted and task_state None.
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:02 user nova-compute[71269]: WARNING nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state deleted and task_state None.
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:02 user nova-compute[71269]: WARNING nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state deleted and task_state None.
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:02 user nova-compute[71269]: WARNING nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-unplugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state deleted and task_state None.
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Acquiring lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] Lock "dc473fb8-e574-4e49-b860-3ae0066cc9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] No waiting events found dispatching network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:02 user nova-compute[71269]: WARNING nova.compute.manager [req-ab2a3ad7-94de-4fc8-a4da-e4150d8d1e0d req-920778b1-92e4-4ce0-acd4-f505e4663acd service nova] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Received unexpected event network-vif-plugged-29e91af8-5b8e-4872-9ee0-9cc4b79fb647 for instance with vm_state deleted and task_state None.
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updating instance_info_cache with network_info: [{"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:11:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:07 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:11:07 user nova-compute[71269]: INFO nova.compute.claims [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Claim successful on node user
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'flavor' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:08 user nova-compute[71269]: INFO nova.compute.manager [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attaching volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac to /dev/vdb
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:11:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.utils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f4970-6dd4-499b-b897-ae79b67a6ed4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[98797c18-64b8-4263-ae59-fd83649f3a08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[34116f52-1bbb-4d7b-97b6-8bf9506fd4f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6166461a-68b3-4707-8774-d4ecd282fd0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.policy [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c235879bc444a819061c4bb4bf3441b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6455f36704e4b3088d8a9114b087fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:11:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Creating image(s)
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "/opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "/opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:11:08 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0e7eb-2350-43b7-ae98-38e43738bb14]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG os_brick.utils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating existing volume attachment record: 8c70e283-407d-4463-b45a-3012c6f1287d {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk 1073741824" returned: 0 in 0.060s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.166s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Cannot resize image /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'migration_context' on Instance uuid d6969342-d92d-4841-99a5-466d2eff89c2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Ensure instance console log exists: /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Successfully created port: 4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Successfully updated port: 4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquired lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-changed-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Refreshing instance network info cache due to event network-changed-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Acquiring lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Updating instance_info_cache with network_info: [{"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Releasing lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Instance network_info: |[{"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Acquired lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Refreshing network info cache for port 4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Start _get_guest_xml network_info=[{"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:11:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1650373439',display_name='tempest-VolumesActionsTest-instance-1650373439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1650373439',id=38,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-9xxe7e1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:08Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d6969342-d92d-4841-99a5-466d2eff89c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'pci_devices' on Instance uuid d6969342-d92d-4841-99a5-466d2eff89c2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:11:10 user nova-compute[71269]:   <uuid>d6969342-d92d-4841-99a5-466d2eff89c2</uuid>
Apr 13 23:11:10 user nova-compute[71269]:   <name>instance-00000026</name>
Apr 13 23:11:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:11:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:11:10 user nova-compute[71269]:   <metadata>
Apr 13 23:11:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:11:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:name>tempest-VolumesActionsTest-instance-1650373439</nova:name>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:11:10</nova:creationTime>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:11:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:11:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:owner>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:user uuid="8c235879bc444a819061c4bb4bf3441b">tempest-VolumesActionsTest-1756435814-project-member</nova:user>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:project uuid="c6455f36704e4b3088d8a9114b087fd3">tempest-VolumesActionsTest-1756435814</nova:project>
Apr 13 23:11:10 user nova-compute[71269]:       </nova:owner>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:11:10 user nova-compute[71269]:       <nova:ports>
Apr 13 23:11:10 user nova-compute[71269]:         <nova:port uuid="4df820e6-69a5-4b4e-a43c-bbbcbd66c02c">
Apr 13 23:11:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 23:11:10 user nova-compute[71269]:         </nova:port>
Apr 13 23:11:10 user nova-compute[71269]:       </nova:ports>
Apr 13 23:11:10 user nova-compute[71269]:     </nova:instance>
Apr 13 23:11:10 user nova-compute[71269]:   </metadata>
Apr 13 23:11:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:11:10 user nova-compute[71269]:     <system>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="serial">d6969342-d92d-4841-99a5-466d2eff89c2</entry>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="uuid">d6969342-d92d-4841-99a5-466d2eff89c2</entry>
Apr 13 23:11:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:11:10 user nova-compute[71269]:     </system>
Apr 13 23:11:10 user nova-compute[71269]:   </sysinfo>
Apr 13 23:11:10 user nova-compute[71269]:   <os>
Apr 13 23:11:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:11:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:11:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:11:10 user nova-compute[71269]:   </os>
Apr 13 23:11:10 user nova-compute[71269]:   <features>
Apr 13 23:11:10 user nova-compute[71269]:     <acpi/>
Apr 13 23:11:10 user nova-compute[71269]:     <apic/>
Apr 13 23:11:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:11:10 user nova-compute[71269]:   </features>
Apr 13 23:11:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:11:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:11:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:11:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:11:10 user nova-compute[71269]:   </clock>
Apr 13 23:11:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:11:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:11:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:11:10 user nova-compute[71269]:   </cpu>
Apr 13 23:11:10 user nova-compute[71269]:   <devices>
Apr 13 23:11:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:11:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:11:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk"/>
Apr 13 23:11:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:11:10 user nova-compute[71269]:     </disk>
Apr 13 23:11:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:11:10 user nova-compute[71269]:       <mac address="fa:16:3e:d1:0d:56"/>
Apr 13 23:11:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:11:10 user nova-compute[71269]:       <target dev="tap4df820e6-69"/>
Apr 13 23:11:10 user nova-compute[71269]:     </interface>
Apr 13 23:11:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:11:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/console.log" append="off"/>
Apr 13 23:11:10 user nova-compute[71269]:     </serial>
Apr 13 23:11:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:11:10 user nova-compute[71269]:     <video>
Apr 13 23:11:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:10 user nova-compute[71269]:     </video>
Apr 13 23:11:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:11:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:11:10 user nova-compute[71269]:     </rng>
Apr 13 23:11:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:11:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:11:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:11:10 user nova-compute[71269]:     </memballoon>
Apr 13 23:11:10 user nova-compute[71269]:   </devices>
Apr 13 23:11:10 user nova-compute[71269]: </domain>
Apr 13 23:11:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1650373439',display_name='tempest-VolumesActionsTest-instance-1650373439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1650373439',id=38,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-9xxe7e1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:08Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d6969342-d92d-4841-99a5-466d2eff89c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG os_vif [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4df820e6-69, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4df820e6-69, col_values=(('external_ids', {'iface-id': '4df820e6-69a5-4b4e-a43c-bbbcbd66c02c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0d:56', 'vm-uuid': 'd6969342-d92d-4841-99a5-466d2eff89c2'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:10 user nova-compute[71269]: INFO os_vif [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69')
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] No VIF found with MAC fa:16:3e:d1:0d:56, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Updated VIF entry in instance network info cache for port 4df820e6-69a5-4b4e-a43c-bbbcbd66c02c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG nova.network.neutron [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Updating instance_info_cache with network_info: [{"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-f0a4b21d-6d44-4dc1-bc40-2dfe41947879 req-b4f8ddc4-9fc7-4a59-8ee2-7625a33a6c2b service nova] Releasing lock "refresh_cache-d6969342-d92d-4841-99a5-466d2eff89c2" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] No waiting events found dispatching network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:12 user nova-compute[71269]: WARNING nova.compute.manager [req-39efa7ea-932d-4bab-9d19-fb93c16679ac req-abfae4c0-aa8b-46ae-9e1f-7a91c0189db7 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received unexpected event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance with vm_state building and task_state spawning.
Apr 13 23:11:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:13 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:13 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:13 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44543d6d-8a0f-4c87-bbd4-a9d98c1fb382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:11:13 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c9d55-2854-4e41-a2b1-bc37831da074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac] added
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c80a2-30c2-4f94-ae59-0a090b82826d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8409fe2-463d-451a-975d-aeaefb624dca]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBlySrDz {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBlySrDz" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5667577a-60d1-49d2-9d83-c3cfcf5afc5f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBlySrDz'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c85241-1dfe-49eb-bf74-8c9501b42e20]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7589c7-f7d5-48fe-9c8d-5e2b103793a2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[56087d2d-180b-4887-a6cd-4493c2963150]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]
Apr 13 23:11:13 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf37d11-e664-4a40-bed4-cc02f132acea]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd9a35-be04-47a3-a602-24594c4e0014]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:13 user nova-compute[71269]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ee3a8-795f-4b33-a1ff-b13e1a3ceb6a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427474.2120028, d6969342-d92d-4841-99a5-466d2eff89c2 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] VM Resumed (Lifecycle Event)
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Instance spawned successfully.
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] No waiting events found dispatching network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:14 user nova-compute[71269]: WARNING nova.compute.manager [req-d45a7b7e-0821-4f0d-8f07-6f8a8fbda293 req-8ee0d3fe-6907-4b75-9412-32f4ec534b2a service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received unexpected event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance with vm_state building and task_state spawning.
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427474.2139149, d6969342-d92d-4841-99a5-466d2eff89c2 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] VM Started (Lifecycle Event)
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Took 5.76 seconds to spawn the instance on the hypervisor.
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:14 user nova-compute[71269]: INFO nova.compute.manager [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Took 6.49 seconds to build instance.
Apr 13 23:11:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d10f64d-403d-42e0-acc4-71a4b92a1914 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26665393938326434', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665393938326434', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'flavor' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:11:14 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:11:14 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:11:14 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:11:14 user nova-compute[71269]:   <serial>3e6ecd5a-e404-40a1-b361-bb3f3c3644ac</serial>
Apr 13 23:11:14 user nova-compute[71269]: </disk>
Apr 13 23:11:14 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:23:cf:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4e873d14-a385-46da-8068-11d826d5258f tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.830s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:15 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427460.5859754, dc473fb8-e574-4e49-b860-3ae0066cc9b8 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:15 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] VM Stopped (Lifecycle Event)
Apr 13 23:11:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f35b7625-cd13-41c2-9ae5-2de74e9bf527 None None] [instance: dc473fb8-e574-4e49-b860-3ae0066cc9b8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:16 user nova-compute[71269]: INFO nova.compute.manager [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Rebuilding instance
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_requests' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'migration_context' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71269) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:17 user nova-compute[71269]: WARNING nova.compute.manager [req-8f88cc53-884f-4f1b-8c32-9da16dc28021 req-c00e5503-ba97-4858-a82c-02452b8abed5 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state rebuilding.
Apr 13 23:11:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance destroyed successfully.
Apr 13 23:11:17 user nova-compute[71269]: INFO nova.compute.manager [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Detaching volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:11:17 user nova-compute[71269]: INFO nova.virt.block_device [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attempting to driver detach volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac from mountpoint /dev/vdb
Apr 13 23:11:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Attempting to detach device vdb from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:11:17 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:11:17 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:11:17 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:11:17 user nova-compute[71269]:   <serial>3e6ecd5a-e404-40a1-b361-bb3f3c3644ac</serial>
Apr 13 23:11:17 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:11:17 user nova-compute[71269]: </disk>
Apr 13 23:11:17 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:11:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully detached device vdb from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the persistent domain config.
Apr 13 23:11:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:17 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 23:11:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b49ef-d8a4-4d3a-82db-95d39a265268]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:11:18 user nova-compute[71269]: No targets found.
Apr 13 23:11:18 user nova-compute[71269]: iSNS:
Apr 13 23:11:18 user nova-compute[71269]: No targets found.
Apr 13 23:11:18 user nova-compute[71269]: STATIC:
Apr 13 23:11:18 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:11:18 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:11:18 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:11:18 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:11:18 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:11:18 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:11:18 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:11:18 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:11:18 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:11:18 user nova-compute[71269]: FIRMWARE:
Apr 13 23:11:18 user nova-compute[71269]: No targets found.
Apr 13 23:11:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:11:18 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:11:18 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c257eff0-5302-472c-8389-d517063c0247]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8b0d14-3e6f-48d2-a450-c3cf47c199b4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:18 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:18 user nova-compute[71269]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:18 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:18 user nova-compute[71269]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c6131c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce026a-0840-4b7b-b6e6-32dac57de3af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b75a6-9dd1-492a-a71f-f7c4477d2418]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2a9bd-c5ab-4b31-9b26-a047bfd5dc5c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a68768-c432-4d12-b781-06826ad86fac]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f011a-4083-42ce-aa2b-8d25a5bd4f2f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c2f42-6a0c-47a1-8702-69624d7abf7c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]
Apr 13 23:11:18 user nova-compute[71269]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.
Apr 13 23:11:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b5470-122c-4a0d-bc08-f3aa608e80b6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (328ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:19 user nova-compute[71269]: WARNING nova.compute.manager [req-5b23acda-92d3-4237-b8af-05d3972fc717 req-930cad4e-f022-415a-95f7-6261220d4676 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state rebuilding.
Apr 13 23:11:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance destroyed successfully.
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09cc0c17-bd, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:11:19 user nova-compute[71269]: INFO os_vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:19 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00dfe5d-0d34-49e9-b062-3e8207498a8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:11:19 user nova-compute[71269]: No targets found.
Apr 13 23:11:19 user nova-compute[71269]: iSNS:
Apr 13 23:11:19 user nova-compute[71269]: No targets found.
Apr 13 23:11:19 user nova-compute[71269]: STATIC:
Apr 13 23:11:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:11:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:11:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:11:19 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:11:19 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:11:19 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:11:19 user nova-compute[71269]: FIRMWARE:
Apr 13 23:11:19 user nova-compute[71269]: No targets found.
Apr 13 23:11:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:11:19 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:11:19 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd2c3b-3446-41db-ac6c-c5846032fcd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de53ac04-8829-4f57-9927-cbedd7c37049]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:19 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:19 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:19 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc34b5b0>, {}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (78ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:11:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Deleting instance files /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_del
Apr 13 23:11:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Deletion of /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_del complete
Apr 13 23:11:19 user nova-compute[71269]: INFO nova.virt.block_device [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Booting with volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac at /dev/vdb
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.utils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bbd978-26a3-4f93-8e3d-e73b45fb43a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c0f6f-0997-4a39-9481-2ebf2bd201dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83e45e-83ef-4adb-9df1-6248f1bea4d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47872cd-844f-4557-a598-e70e141875ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:11:19 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:11:19 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3106ea7-a0dd-4e37-b7d4-8dc25b665a72]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG os_brick.utils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:19 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating existing volume attachment record: 0af8431b-1b33-4a73-baa9-32b08f3006c9 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:11:20 user nova-compute[71269]: INFO nova.compute.claims [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Claim successful on node user
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:11:20 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:11:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.policy [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:11:21 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Creating image(s)
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "/opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "/opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk 1073741824" returned: 0 in 0.224s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Cannot resize image /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'migration_context' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Ensure instance console log exists: /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Successfully created port: ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Successfully updated port: ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-changed-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Refreshing instance network info cache due to event network-changed-ce4496b6-af8d-489a-86cb-963886c9d30c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Acquiring lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Acquired lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Refreshing network info cache for port ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:11:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-29da2b02-0b5e-47e1-a2f9-4088c4e17072 req-832dd8e8-e792-4486-8a70-7c20d570f18b service nova] Releasing lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquired lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Updating instance_info_cache with network_info: [{"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Releasing lock "refresh_cache-d0b702ab-bc03-49c0-9ae6-376e9276f717" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance network_info: |[{"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Start _get_guest_xml network_info=[{"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:11:23 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:23 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1939537437',display_name='tempest-VolumesSnapshotTestJSON-instance-1939537437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1939537437',id=39,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-c32l1yev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:21Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=d0b702ab-bc03-49c0-9ae6-376e9276f717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'pci_devices' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:11:23 user nova-compute[71269]:   <uuid>d0b702ab-bc03-49c0-9ae6-376e9276f717</uuid>
Apr 13 23:11:23 user nova-compute[71269]:   <name>instance-00000027</name>
Apr 13 23:11:23 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:11:23 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:11:23 user nova-compute[71269]:   <metadata>
Apr 13 23:11:23 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:11:23 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1939537437</nova:name>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:11:23</nova:creationTime>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:11:23 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:11:23 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:owner>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:user uuid="5a1420e7febd479e8f23ad9784950f65">tempest-VolumesSnapshotTestJSON-1344748200-project-member</nova:user>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:project uuid="5cebfec442634e41b173904833269463">tempest-VolumesSnapshotTestJSON-1344748200</nova:project>
Apr 13 23:11:23 user nova-compute[71269]:       </nova:owner>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:11:23 user nova-compute[71269]:       <nova:ports>
Apr 13 23:11:23 user nova-compute[71269]:         <nova:port uuid="ce4496b6-af8d-489a-86cb-963886c9d30c">
Apr 13 23:11:23 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:11:23 user nova-compute[71269]:         </nova:port>
Apr 13 23:11:23 user nova-compute[71269]:       </nova:ports>
Apr 13 23:11:23 user nova-compute[71269]:     </nova:instance>
Apr 13 23:11:23 user nova-compute[71269]:   </metadata>
Apr 13 23:11:23 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:11:23 user nova-compute[71269]:     <system>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="serial">d0b702ab-bc03-49c0-9ae6-376e9276f717</entry>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="uuid">d0b702ab-bc03-49c0-9ae6-376e9276f717</entry>
Apr 13 23:11:23 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:11:23 user nova-compute[71269]:     </system>
Apr 13 23:11:23 user nova-compute[71269]:   </sysinfo>
Apr 13 23:11:23 user nova-compute[71269]:   <os>
Apr 13 23:11:23 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:11:23 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:11:23 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:11:23 user nova-compute[71269]:   </os>
Apr 13 23:11:23 user nova-compute[71269]:   <features>
Apr 13 23:11:23 user nova-compute[71269]:     <acpi/>
Apr 13 23:11:23 user nova-compute[71269]:     <apic/>
Apr 13 23:11:23 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:11:23 user nova-compute[71269]:   </features>
Apr 13 23:11:23 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:11:23 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:11:23 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:11:23 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:11:23 user nova-compute[71269]:   </clock>
Apr 13 23:11:23 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:11:23 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:11:23 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:11:23 user nova-compute[71269]:   </cpu>
Apr 13 23:11:23 user nova-compute[71269]:   <devices>
Apr 13 23:11:23 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:11:23 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:11:23 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk"/>
Apr 13 23:11:23 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:11:23 user nova-compute[71269]:     </disk>
Apr 13 23:11:23 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:11:23 user nova-compute[71269]:       <mac address="fa:16:3e:d9:97:b7"/>
Apr 13 23:11:23 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:23 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:11:23 user nova-compute[71269]:       <target dev="tapce4496b6-af"/>
Apr 13 23:11:23 user nova-compute[71269]:     </interface>
Apr 13 23:11:23 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:11:23 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/console.log" append="off"/>
Apr 13 23:11:23 user nova-compute[71269]:     </serial>
Apr 13 23:11:23 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:11:23 user nova-compute[71269]:     <video>
Apr 13 23:11:23 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:23 user nova-compute[71269]:     </video>
Apr 13 23:11:23 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:11:23 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:11:23 user nova-compute[71269]:     </rng>
Apr 13 23:11:23 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:11:23 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:11:23 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:11:23 user nova-compute[71269]:     </memballoon>
Apr 13 23:11:23 user nova-compute[71269]:   </devices>
Apr 13 23:11:23 user nova-compute[71269]: </domain>
Apr 13 23:11:23 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1939537437',display_name='tempest-VolumesSnapshotTestJSON-instance-1939537437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1939537437',id=39,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-c32l1yev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:21Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=d0b702ab-bc03-49c0-9ae6-376e9276f717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG os_vif [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce4496b6-af, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce4496b6-af, col_values=(('external_ids', {'iface-id': 'ce4496b6-af8d-489a-86cb-963886c9d30c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:97:b7', 'vm-uuid': 'd0b702ab-bc03-49c0-9ae6-376e9276f717'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:23 user nova-compute[71269]: INFO os_vif [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af')
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No VIF found with MAC fa:16:3e:d9:97:b7, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:11:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:11:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating image(s)
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk 1073741824" returned: 0 in 0.048s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Cannot resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start _get_guest_xml network_info=[{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0af8431b-1b33-4a73-baa9-32b08f3006c9', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d', 'attached_at': '', 'detached_at': '', 'volume_id': '3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'serial': '3e6ecd5a-e404-40a1-b361-bb3f3c3644ac'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:11:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 23:11:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:11:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:11:25 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c291aa-1f5a-4a2e-8f7a-47a06c95b6f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:11:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d4920c-b89a-4b78-9bcf-cdeae2a90972]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac] added
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265ff5c-c702-4fd2-8d42-d16ee326b449]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99abc16-02ee-4556-b4a1-50553148b081]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBlySrDz {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBlySrDz" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[243621ca-e6d3-4eae-a842-fa2d30579435]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBlySrDz'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[416f0867-dde0-4442-a591-fed3ffc40274]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8143579e-c392-48c7-b221-c9888a3ec923]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] No waiting events found dispatching network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:25 user nova-compute[71269]: WARNING nova.compute.manager [req-219a4f45-5afe-4ead-a697-cbcf8da4412f req-2aa59e1b-47b5-4eee-a606-df9ed310fbf9 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received unexpected event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c for instance with vm_state building and task_state spawning.
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27965875-b7fc-4035-9d95-d8cde7b18cef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]
Apr 13 23:11:25 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.244s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8794a740-77ba-4403-8711-14b82ddd6435]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d2dab-e5e6-4b7a-ad5b-ab4f276384fc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:11:25 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:11:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.539s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b84b5cd-0295-4e98-abfb-bc50d2749c15]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:11:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.574s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '26665393938326434', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665393938326434', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:11:26 user nova-compute[71269]:   <uuid>d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</uuid>
Apr 13 23:11:26 user nova-compute[71269]:   <name>instance-00000021</name>
Apr 13 23:11:26 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:11:26 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:11:26 user nova-compute[71269]:   <metadata>
Apr 13 23:11:26 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:11:26 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-19843969</nova:name>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:11:25</nova:creationTime>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:11:26 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:11:26 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:owner>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:11:26 user nova-compute[71269]:       </nova:owner>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:11:26 user nova-compute[71269]:       <nova:ports>
Apr 13 23:11:26 user nova-compute[71269]:         <nova:port uuid="09cc0c17-bd49-4207-9de4-89178a1e681e">
Apr 13 23:11:26 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:11:26 user nova-compute[71269]:         </nova:port>
Apr 13 23:11:26 user nova-compute[71269]:       </nova:ports>
Apr 13 23:11:26 user nova-compute[71269]:     </nova:instance>
Apr 13 23:11:26 user nova-compute[71269]:   </metadata>
Apr 13 23:11:26 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:11:26 user nova-compute[71269]:     <system>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="serial">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="uuid">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:11:26 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:11:26 user nova-compute[71269]:     </system>
Apr 13 23:11:26 user nova-compute[71269]:   </sysinfo>
Apr 13 23:11:26 user nova-compute[71269]:   <os>
Apr 13 23:11:26 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:11:26 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:11:26 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:11:26 user nova-compute[71269]:   </os>
Apr 13 23:11:26 user nova-compute[71269]:   <features>
Apr 13 23:11:26 user nova-compute[71269]:     <acpi/>
Apr 13 23:11:26 user nova-compute[71269]:     <apic/>
Apr 13 23:11:26 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:11:26 user nova-compute[71269]:   </features>
Apr 13 23:11:26 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:11:26 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:11:26 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:11:26 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:11:26 user nova-compute[71269]:   </clock>
Apr 13 23:11:26 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:11:26 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:11:26 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:11:26 user nova-compute[71269]:   </cpu>
Apr 13 23:11:26 user nova-compute[71269]:   <devices>
Apr 13 23:11:26 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:11:26 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:11:26 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk"/>
Apr 13 23:11:26 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:11:26 user nova-compute[71269]:     </disk>
Apr 13 23:11:26 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:11:26 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:11:26 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:11:26 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:11:26 user nova-compute[71269]:       <serial>3e6ecd5a-e404-40a1-b361-bb3f3c3644ac</serial>
Apr 13 23:11:26 user nova-compute[71269]:     </disk>
Apr 13 23:11:26 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:11:26 user nova-compute[71269]:       <mac address="fa:16:3e:23:cf:d9"/>
Apr 13 23:11:26 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:26 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:11:26 user nova-compute[71269]:       <target dev="tap09cc0c17-bd"/>
Apr 13 23:11:26 user nova-compute[71269]:     </interface>
Apr 13 23:11:26 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:11:26 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log" append="off"/>
Apr 13 23:11:26 user nova-compute[71269]:     </serial>
Apr 13 23:11:26 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:11:26 user nova-compute[71269]:     <video>
Apr 13 23:11:26 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:11:26 user nova-compute[71269]:     </video>
Apr 13 23:11:26 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:11:26 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:11:26 user nova-compute[71269]:     </rng>
Apr 13 23:11:26 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:11:26 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:11:26 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:11:26 user nova-compute[71269]:     </memballoon>
Apr 13 23:11:26 user nova-compute[71269]:   </devices>
Apr 13 23:11:26 user nova-compute[71269]: </domain>
Apr 13 23:11:26 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG os_vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09cc0c17-bd, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09cc0c17-bd, col_values=(('external_ids', {'iface-id': '09cc0c17-bd49-4207-9de4-89178a1e681e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:cf:d9', 'vm-uuid': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:11:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:26 user nova-compute[71269]: INFO os_vif [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:23:cf:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] No waiting events found dispatching network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:27 user nova-compute[71269]: WARNING nova.compute.manager [req-6b34e203-4b60-4699-a25d-3ae93e0162ac req-5bc41395-7234-4517-bc43-53de9467de91 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received unexpected event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c for instance with vm_state building and task_state spawning.
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427487.6910696, d0b702ab-bc03-49c0-9ae6-376e9276f717 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] VM Resumed (Lifecycle Event)
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance spawned successfully.
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427487.6939123, d0b702ab-bc03-49c0-9ae6-376e9276f717 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] VM Started (Lifecycle Event)
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Took 6.77 seconds to spawn the instance on the hypervisor.
Apr 13 23:11:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:27 user nova-compute[71269]: INFO nova.compute.manager [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Took 7.75 seconds to build instance.
Apr 13 23:11:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c3b24342-8364-4980-ad6d-0ea142275bd4 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:28 user nova-compute[71269]: WARNING nova.compute.manager [req-764cbf7a-9e5f-43fb-8e8a-53a18c05c4b2 req-9ab43657-8aba-4afe-b959-8b62f8e54f30 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state rebuild_spawning.
Apr 13 23:11:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427490.693618, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Resumed (Lifecycle Event)
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:11:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance spawned successfully.
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:30 user nova-compute[71269]: WARNING nova.compute.manager [req-b2ee2df8-02d7-4a98-83b6-b5ea808ae2f9 req-7947ba1a-6a8f-43dc-b2d8-0cfba5bbea6b service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state rebuild_spawning.
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427490.6956296, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Started (Lifecycle Event)
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:30 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71269) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 23:11:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-893ef8dc-9146-402a-9cc0-432d860b53cd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:44 user nova-compute[71269]: INFO nova.compute.manager [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Unrescuing
Apr 13 23:11:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:11:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquired lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:11:44 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG nova.network.neutron [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating instance_info_cache with network_info: [{"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Releasing lock "refresh_cache-a9e9744c-04d3-486e-b032-90c672927962" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'flavor' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG nova.compute.manager [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:45 user nova-compute[71269]: WARNING nova.compute.manager [req-78cfe71a-50a8-4f0b-9a97-af4c57a92e37 req-25a3ab9a-88d3-4865-bc91-8109f48c3165 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:11:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:46 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance destroyed successfully.
Apr 13 23:11:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG nova.compute.manager [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:47 user nova-compute[71269]: WARNING nova.compute.manager [req-030fd457-f453-4433-aca5-20337d06f9da req-8495cc27-4fb7-4ec0-9442-1339f0442183 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for a9e9744c-04d3-486e-b032-90c672927962 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427509.881117, a9e9744c-04d3-486e-b032-90c672927962 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:49 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Resumed (Lifecycle Event)
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6084b504-ebf2-49f6-88aa-755870e2172d tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:49 user nova-compute[71269]: WARNING nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:11:49 user nova-compute[71269]: WARNING nova.compute.manager [req-8c0058d8-650c-486e-aa1c-f6e57776e8ee req-9039be6f-ab9e-4bca-afa8-80f8ad69624b service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state rescued and task_state unrescuing.
Apr 13 23:11:49 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427509.8823757, a9e9744c-04d3-486e-b032-90c672927962 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:11:49 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Started (Lifecycle Event)
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:11:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:11:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:11:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:11:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:11:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:11:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:11:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:11:59 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:02 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:12:02 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=26.137744903564453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a9e9744c-04d3-486e-b032-90c672927962 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d6969342-d92d-4841-99a5-466d2eff89c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:12:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:12:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing instance network info cache due to event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updated VIF entry in instance network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:12:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6c8597b6-b56a-4d06-81fd-a616cecc2029 req-29bbd704-9d97-4670-9be8-dad78f72ec52 service nova] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:43 user nova-compute[71269]: INFO nova.compute.manager [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attaching volume dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 to /dev/vdb
Apr 13 23:12:43 user nova-compute[71269]: DEBUG os_brick.utils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3343a35-fbd9-49b3-b72c-b40ff0f778a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b670d6ea-3cf5-498d-be84-000e85a131fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a836811-abf5-4b83-9137-1928ed53f9d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d314097a-d9c5-44e5-9dd3-1cde4f709b1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:12:44 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:12:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5f908-a9e7-4736-af0a-28c36a979f0f]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG os_brick.utils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:12:44 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating existing volume attachment record: cd89a592-ea59-4e61-8dd0-cf7eed9479f5 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:12:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSOMEWuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:12:48 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:12:48 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:12:48 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc02e4-b1c1-4af9-98ba-dee700f1ea3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:12:48 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57aa72e-1966-4332-94f2-1a7f3b29eb39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0] added
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d9291a-33a6-4e2e-a8dd-df56d036eba8]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b795083c-d07c-4455-8998-53a71cec94c0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSOMEWuY {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSOMEWuY" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd7cd7-8a1c-4715-8b13-7844b5785629]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSOMEWuY'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd32e5-e220-4405-a0bd-55007215e638]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bdf621-4182-4531-914b-a6a37e4c41b6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8503c3-0657-46e1-bdd7-6957e913865d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260]
Apr 13 23:12:48 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260] successful.
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8d5563-eb41-4cdc-827f-77af686ea6cf]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a437211e-4cc9-4d3c-ab75-11c459cdc401]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:12:48 user nova-compute[71269]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)
Apr 13 23:12:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422b8a3-ebff-431f-8096-6d64d579fc6e]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSOMEWuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:12:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:12:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23661313435613333', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:12:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661313435613333', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:12:49 user nova-compute[71269]: DEBUG nova.objects.instance [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:12:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:12:49 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:12:49 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:12:49 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:12:49 user nova-compute[71269]:   <serial>dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0</serial>
Apr 13 23:12:49 user nova-compute[71269]: </disk>
Apr 13 23:12:49 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:12:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:12:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:12:50 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No VIF found with MAC fa:16:3e:80:4c:a0, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:12:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-03b600e9-033a-48b8-9f70-f8255bb63e25 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.398s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:12:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:57 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:57 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:12:58 user nova-compute[71269]: INFO nova.compute.manager [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Terminating instance
Apr 13 23:12:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-unplugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] No waiting events found dispatching network-vif-unplugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG nova.compute.manager [req-7706278a-5b5d-41c7-a7b4-087ab8039f74 req-e5ffdd30-a3a9-4536-8359-e2d8eb35925f service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-unplugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:59 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Instance destroyed successfully.
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lazy-loading 'resources' on Instance uuid d6969342-d92d-4841-99a5-466d2eff89c2 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1650373439',display_name='tempest-VolumesActionsTest-instance-1650373439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1650373439',id=38,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6455f36704e4b3088d8a9114b087fd3',ramdisk_id='',reservation_id='r-9xxe7e1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1756435814',owner_user_name='tempest-VolumesActionsTest-1756435814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:11:14Z,user_data=None,user_id='8c235879bc444a819061c4bb4bf3441b',uuid=d6969342-d92d-4841-99a5-466d2eff89c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converting VIF {"id": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "address": "fa:16:3e:d1:0d:56", "network": {"id": "6d2922dc-e5ab-475a-9b4e-453595ade8a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-863553625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c6455f36704e4b3088d8a9114b087fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df820e6-69", "ovs_interfaceid": "4df820e6-69a5-4b4e-a43c-bbbcbd66c02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG os_vif [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4df820e6-69, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:12:59 user nova-compute[71269]: INFO os_vif [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0d:56,bridge_name='br-int',has_traffic_filtering=True,id=4df820e6-69a5-4b4e-a43c-bbbcbd66c02c,network=Network(6d2922dc-e5ab-475a-9b4e-453595ade8a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4df820e6-69')
Apr 13 23:12:59 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Deleting instance files /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2_del
Apr 13 23:12:59 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Deletion of /opt/stack/data/nova/instances/d6969342-d92d-4841-99a5-466d2eff89c2_del complete
Apr 13 23:12:59 user nova-compute[71269]: INFO nova.compute.manager [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Took 0.79 seconds to destroy the instance on the hypervisor.
Apr 13 23:12:59 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:12:59 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Took 0.50 seconds to deallocate network for instance.
Apr 13 23:12:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:12:59 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:00 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Deleted allocations for instance d6969342-d92d-4841-99a5-466d2eff89c2
Apr 13 23:13:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c6a6388c-fce2-4b11-9162-f7b8bdb95205 tempest-VolumesActionsTest-1756435814 tempest-VolumesActionsTest-1756435814-project-member] Lock "d6969342-d92d-4841-99a5-466d2eff89c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Acquiring lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] Lock "d6969342-d92d-4841-99a5-466d2eff89c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] No waiting events found dispatching network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:13:00 user nova-compute[71269]: WARNING nova.compute.manager [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received unexpected event network-vif-plugged-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c for instance with vm_state deleted and task_state None.
Apr 13 23:13:00 user nova-compute[71269]: DEBUG nova.compute.manager [req-299565eb-9f0a-43c3-bacf-718c0efa34d9 req-de4b0016-3900-486f-9666-ea30ff84adf9 service nova] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Received event network-vif-deleted-4df820e6-69a5-4b4e-a43c-bbbcbd66c02c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:01 user nova-compute[71269]: INFO nova.compute.manager [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Detaching volume dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0
Apr 13 23:13:01 user nova-compute[71269]: INFO nova.virt.block_device [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attempting to driver detach volume dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 from mountpoint /dev/vdb
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Attempting to detach device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:13:01 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:13:01 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:13:01 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:13:01 user nova-compute[71269]:   <serial>dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0</serial>
Apr 13 23:13:01 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:13:01 user nova-compute[71269]: </disk>
Apr 13 23:13:01 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:13:01 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config.
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:13:01 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:13:01 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:13:01 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:13:01 user nova-compute[71269]:   <serial>dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0</serial>
Apr 13 23:13:01 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:13:01 user nova-compute[71269]: </disk>
Apr 13 23:13:01 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427581.7794454, 9de39303-da44-47ae-adef-ff80f0b792a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:13:01 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config.
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSOMEWuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:01 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc159f1-5ea5-484f-b8b6-31505b22fc9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:13:01 user nova-compute[71269]: No targets found.
Apr 13 23:13:01 user nova-compute[71269]: iSNS:
Apr 13 23:13:01 user nova-compute[71269]: No targets found.
Apr 13 23:13:01 user nova-compute[71269]: STATIC:
Apr 13 23:13:01 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:13:01 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:01 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:01 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:13:01 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:01 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:01 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:13:01 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:01 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:01 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0
Apr 13 23:13:01 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:01 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:01 user nova-compute[71269]: FIRMWARE:
Apr 13 23:13:01 user nova-compute[71269]: No targets found.
Apr 13 23:13:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:13:01 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:13:01 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ae999-23c4-43db-b82a-51d02b7cbb1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcf39d-c0d9-46d5-9543-76ee6690aae7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:01 user nova-compute[71269]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 (non-flash)
Apr 13 23:13:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc3cd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4ff0e-1321-4f5d-81c6-d469c57a0302]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37505301-bef7-4443-8316-a17b5b66a06c]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66555a44-ef7c-4fcf-936a-c74e5730b6fe]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4119e-e590-4168-9692-040332ba9c0c]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:13:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24aa8dd-e300-4650-9614-09ac1493d375]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aecb476-0f23-4ea5-aa18-fd726ae5a2c5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260]
Apr 13 23:13:02 user nova-compute[71269]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0, portal: 172.16.0.220,3260] successful.
Apr 13 23:13:02 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6f443c-fdd0-4c41-a7c0-5cb91ce7aff0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f5e033-3dba-4061-8d20-1146b58b0621]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== disconnect_volume: return (344ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:13:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG nova.objects.instance [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-547c3624-f9fb-4d94-ba59-98d8453b880c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:13:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=26.15235137939453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance a9e9744c-04d3-486e-b032-90c672927962 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d0b702ab-bc03-49c0-9ae6-376e9276f717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:13:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:13:05 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [{"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-7226cc11-4c2c-4a27-bb02-87ba1f749d33" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Ignoring supplied device name: /dev/vdb
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:10 user nova-compute[71269]: INFO nova.compute.manager [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Attaching volume 5454d9c9-8d3f-42b7-b2f6-75caddff713f to /dev/vdb
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.utils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6751845-7da3-49c8-8fc7-a3b1cde89b3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a9084-902b-4905-840a-dca0be995e1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a87afcc-91b6-4fb7-8125-0db337aae51d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7135ed5b-d1ab-456f-aeb8-6df714a436b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:13:10 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:13:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa96c17-aa7f-4dd7-b4ff-d8061d48d3ef]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG os_brick.utils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:10 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Updating existing volume attachment record: 1016a229-dfc2-4b2f-b001-ce790ab43ad3 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:13:13 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427578.9925148, d6969342-d92d-4841-99a5-466d2eff89c2 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:13:13 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] VM Stopped (Lifecycle Event)
Apr 13 23:13:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-645dd9ee-fbb8-4866-a58f-f3bf542fd1af None None] [instance: d6969342-d92d-4841-99a5-466d2eff89c2] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:13:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:13:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgxszOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:14 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:14 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:15 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:15 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abce235-5b4f-4a44-afd5-35f0cafad805]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:13:15 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81557e08-5cf6-4d65-b71b-2fdd267e0328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f] added
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f674338-502d-4df5-a74f-d581f76ea447]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b696d33-156a-4274-b50c-bef66cf12bc4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgxszOrA {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgxszOrA" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f562ba3f-0dc5-40f8-9543-1ac517a67bba]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgxszOrA'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9d3cda-f8cb-45f4-9ed9-0e4953f8a9fa]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f9476-6bdf-4f2f-b975-80885b3cde49]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409e1d1-9b93-4610-805d-37043456a93a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260]
Apr 13 23:13:15 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260] successful.
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66e5883-4e46-4fe2-89ae-adf2d0ba0f3b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6465f8b-74b4-4843-a4c1-040089ad384c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:15 user nova-compute[71269]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)
Apr 13 23:13:15 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f969a8-6bf9-4254-ad62-794dd54eca6f]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:15 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgxszOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23736303438313236', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736303438313236', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.objects.instance [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:13:16 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:13:16 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:13:16 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:13:16 user nova-compute[71269]:   <serial>5454d9c9-8d3f-42b7-b2f6-75caddff713f</serial>
Apr 13 23:13:16 user nova-compute[71269]: </disk>
Apr 13 23:13:16 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No VIF found with MAC fa:16:3e:d9:97:b7, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:13:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-aee25517-f9a4-482f-a2c0-e2fd534f7f57 tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.679s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:13:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:34 user nova-compute[71269]: INFO nova.compute.manager [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Detaching volume 5454d9c9-8d3f-42b7-b2f6-75caddff713f
Apr 13 23:13:34 user nova-compute[71269]: INFO nova.virt.block_device [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Attempting to driver detach volume 5454d9c9-8d3f-42b7-b2f6-75caddff713f from mountpoint /dev/vdb
Apr 13 23:13:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Attempting to detach device vdb from instance d0b702ab-bc03-49c0-9ae6-376e9276f717 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:13:34 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:13:34 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:13:34 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:13:34 user nova-compute[71269]:   <serial>5454d9c9-8d3f-42b7-b2f6-75caddff713f</serial>
Apr 13 23:13:34 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:13:34 user nova-compute[71269]: </disk>
Apr 13 23:13:34 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:13:34 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully detached device vdb from instance d0b702ab-bc03-49c0-9ae6-376e9276f717 from the persistent domain config.
Apr 13 23:13:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0b702ab-bc03-49c0-9ae6-376e9276f717 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:13:34 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:13:34 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:13:34 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:13:34 user nova-compute[71269]:   <serial>5454d9c9-8d3f-42b7-b2f6-75caddff713f</serial>
Apr 13 23:13:34 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:13:34 user nova-compute[71269]: </disk>
Apr 13 23:13:34 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:13:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427615.0537553, d0b702ab-bc03-49c0-9ae6-376e9276f717 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:13:35 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully detached device vdb from instance d0b702ab-bc03-49c0-9ae6-376e9276f717 from the live domain config.
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgxszOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87154142-f30d-48e5-8140-3a61baa66f5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:13:35 user nova-compute[71269]: No targets found.
Apr 13 23:13:35 user nova-compute[71269]: iSNS:
Apr 13 23:13:35 user nova-compute[71269]: No targets found.
Apr 13 23:13:35 user nova-compute[71269]: STATIC:
Apr 13 23:13:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:13:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:13:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:13:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:35 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f
Apr 13 23:13:35 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:35 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:35 user nova-compute[71269]: FIRMWARE:
Apr 13 23:13:35 user nova-compute[71269]: No targets found.
Apr 13 23:13:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:13:35 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:13:35 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97767d0-2ffa-4e32-a7ac-968d266025ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c42c3-6618-4708-bf7e-eade5c6eabf8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)
Apr 13 23:13:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:35 user nova-compute[71269]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f (non-flash)
Apr 13 23:13:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cbfa31-1925-4cdb-9781-b3abf28b5a4e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d57138-957b-44e2-b239-42f50ce24add]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d758a1-e0d3-4ff6-91fe-61c62d71b88a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[72409dc5-b976-44e6-862d-bc8fb1c8e798]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8b199-c44c-4f5d-95e4-03b90e43f807]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df7adb-e655-4670-b1fa-4c433062a788]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260]
Apr 13 23:13:35 user nova-compute[71269]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f, portal: 172.16.0.220,3260] successful.
Apr 13 23:13:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9ed80c-05d8-4a5f-9d32-34e2729970cd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== disconnect_volume: return (313ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:35 user nova-compute[71269]: INFO nova.compute.manager [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Terminating instance
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG nova.compute.manager [req-92570266-4d65-4f2a-a20b-7913e873a430 req-5dbd6a09-80ab-48c9-a057-f71fea8073be service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-unplugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-054f118f-cca1-4383-bd8c-8e9ace63e2af tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.577s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:36 user nova-compute[71269]: INFO nova.compute.manager [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Terminating instance
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:13:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Instance destroyed successfully.
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid a9e9744c-04d3-486e-b032-90c672927962 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874091226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874091226',id=35,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-4e758seo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:11:50Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=a9e9744c-04d3-486e-b032-90c672927962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "address": "fa:16:3e:af:76:cc", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae6b103-e1", "ovs_interfaceid": "7ae6b103-e1c6-42e6-9fcd-e76353955a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_vif [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ae6b103-e1, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:36 user nova-compute[71269]: INFO os_vif [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:76:cc,bridge_name='br-int',has_traffic_filtering=True,id=7ae6b103-e1c6-42e6-9fcd-e76353955a76,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae6b103-e1')
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnklUCFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:36 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865b7b6-8907-4945-b8a5-475d89e45d70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:13:36 user nova-compute[71269]: No targets found.
Apr 13 23:13:36 user nova-compute[71269]: iSNS:
Apr 13 23:13:36 user nova-compute[71269]: No targets found.
Apr 13 23:13:36 user nova-compute[71269]: STATIC:
Apr 13 23:13:36 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:13:36 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:36 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:36 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70
Apr 13 23:13:36 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:36 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:36 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:13:36 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:36 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:36 user nova-compute[71269]: FIRMWARE:
Apr 13 23:13:36 user nova-compute[71269]: No targets found.
Apr 13 23:13:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:13:36 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:13:36 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0716d6-ad44-46f0-978e-84dfe5cc7016]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[300823c0-4f46-4f54-a769-5726d984490c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:36 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:36 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:36 user nova-compute[71269]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 (non-flash)
Apr 13 23:13:36 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6943440-48bf-4f20-9c26-140cd98f5726]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afdfbe9-3310-4cf2-8df7-24a272597e17]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134b99f-1d95-4aed-aedc-a8b917964bc2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[831d1c86-4590-428b-937e-b18527f9d8b9]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23163623630353863', '/dev/disk/by-id/scsi-1SCST_BIOe05163b9-1cb6058cb54a197a') {{(pid=81834) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 23:13:36 user nova-compute[71269]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23163623630353863
Apr 13 23:13:36 user nova-compute[71269]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe05163b9-1cb6058cb54a197a
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c85ee-c84b-41c6-886d-b6ae41fc9358]: (4, None) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09dd403-b919-4097-b38c-68ba5644dc24]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e4a410-7073-4247-a23a-09b9bfa40c7a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260]
Apr 13 23:13:36 user nova-compute[71269]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70, portal: 172.16.0.220,3260] successful.
Apr 13 23:13:36 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92d2bbb-41da-4e9d-8f75-49194054cd70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99c6b0-5fd4-430a-a79a-4d60a071b848]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== disconnect_volume: return (352ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:13:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Deleting instance files /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962_del
Apr 13 23:13:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Deletion of /opt/stack/data/nova/instances/a9e9744c-04d3-486e-b032-90c672927962_del complete
Apr 13 23:13:36 user nova-compute[71269]: INFO nova.compute.manager [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 13 23:13:36 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:13:36 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Instance destroyed successfully.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.objects.instance [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'resources' on Instance uuid d0b702ab-bc03-49c0-9ae6-376e9276f717 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1939537437',display_name='tempest-VolumesSnapshotTestJSON-instance-1939537437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1939537437',id=39,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-c32l1yev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:11:28Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=d0b702ab-bc03-49c0-9ae6-376e9276f717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "ce4496b6-af8d-489a-86cb-963886c9d30c", "address": "fa:16:3e:d9:97:b7", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4496b6-af", "ovs_interfaceid": "ce4496b6-af8d-489a-86cb-963886c9d30c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_vif [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce4496b6-af, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:37 user nova-compute[71269]: INFO os_vif [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:97:b7,bridge_name='br-int',has_traffic_filtering=True,id=ce4496b6-af8d-489a-86cb-963886c9d30c,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4496b6-af')
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgxszOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:37 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[026f85fb-adcc-47d4-8b29-d115dc202984]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:13:37 user nova-compute[71269]: No targets found.
Apr 13 23:13:37 user nova-compute[71269]: iSNS:
Apr 13 23:13:37 user nova-compute[71269]: No targets found.
Apr 13 23:13:37 user nova-compute[71269]: STATIC:
Apr 13 23:13:37 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:13:37 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:37 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:37 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:13:37 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:13:37 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:13:37 user nova-compute[71269]: FIRMWARE:
Apr 13 23:13:37 user nova-compute[71269]: No targets found.
Apr 13 23:13:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:13:37 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:13:37 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5454d9c9-8d3f-42b7-b2f6-75caddff713f', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745f519-ddf5-42f5-951e-2a17c6ce73b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805a65a-40a3-430d-8591-dd66d5151025]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:37 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:13:37 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:13:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c689510>, {}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Disconnecting from: [] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== disconnect_volume: return (69ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Deleting instance files /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717_del
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Deletion of /opt/stack/data/nova/instances/d0b702ab-bc03-49c0-9ae6-376e9276f717_del complete
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.compute.manager [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] Took 0.56 seconds to deallocate network for instance.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-e0ee1674-a07c-4319-8674-009e30ad0bb3 req-c9f139ac-da6b-4148-a482-f900c410d19a service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-deleted-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Took 0.55 seconds to deallocate network for instance.
Apr 13 23:13:37 user nova-compute[71269]: WARNING nova.volume.cinder [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Attachment 1016a229-dfc2-4b2f-b001-ce790ab43ad3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1016a229-dfc2-4b2f-b001-ce790ab43ad3. (HTTP 404) (Request-ID: req-2074635d-4217-431e-abe7-2d4efef9339b)
Apr 13 23:13:37 user nova-compute[71269]: INFO nova.compute.manager [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Acquiring lock "a9e9744c-04d3-486e-b032-90c672927962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "a9e9744c-04d3-486e-b032-90c672927962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] No waiting events found dispatching network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:13:37 user nova-compute[71269]: WARNING nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: a9e9744c-04d3-486e-b032-90c672927962] Received unexpected event network-vif-plugged-7ae6b103-e1c6-42e6-9fcd-e76353955a76 for instance with vm_state active and task_state deleting.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-vif-unplugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] No waiting events found dispatching network-vif-unplugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:13:37 user nova-compute[71269]: WARNING nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received unexpected event network-vif-unplugged-ce4496b6-af8d-489a-86cb-963886c9d30c for instance with vm_state deleted and task_state None.
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Acquiring lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:37 user nova-compute[71269]: DEBUG nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] No waiting events found dispatching network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:13:37 user nova-compute[71269]: WARNING nova.compute.manager [req-7f6a7bf2-5e4f-4dc2-885d-c29d43b49d61 req-26e7127a-cce5-4b57-873b-4561d937deb8 service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received unexpected event network-vif-plugged-ce4496b6-af8d-489a-86cb-963886c9d30c for instance with vm_state deleted and task_state None.
Apr 13 23:13:38 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:38 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Deleted allocations for instance d0b702ab-bc03-49c0-9ae6-376e9276f717
Apr 13 23:13:38 user nova-compute[71269]: INFO nova.compute.manager [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: a9e9744c-04d3-486e-b032-90c672927962] Took 0.98 seconds to detach 1 volumes for instance.
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bf00b351-e0bb-410e-9005-011711bc4a4d tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "d0b702ab-bc03-49c0-9ae6-376e9276f717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:38 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Deleted allocations for instance a9e9744c-04d3-486e-b032-90c672927962
Apr 13 23:13:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-0d44676e-cabb-4765-8aea-b9e6fab95187 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "a9e9744c-04d3-486e-b032-90c672927962" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.210s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-858f9f12-f365-47dd-8388-db2618370adc req-38bea3de-0190-4c18-8a55-3fa519cb1c7f service nova] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Received event network-vif-deleted-ce4496b6-af8d-489a-86cb-963886c9d30c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:13:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:49 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:13:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:13:50 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:51 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427616.3075604, a9e9744c-04d3-486e-b032-90c672927962 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:13:51 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: a9e9744c-04d3-486e-b032-90c672927962] VM Stopped (Lifecycle Event)
Apr 13 23:13:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2106157e-7d23-400d-a062-08e043cc9786 None None] [instance: a9e9744c-04d3-486e-b032-90c672927962] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:13:52 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427617.0424297, d0b702ab-bc03-49c0-9ae6-376e9276f717 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:13:52 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] VM Stopped (Lifecycle Event)
Apr 13 23:13:52 user nova-compute[71269]: DEBUG nova.compute.manager [None req-17767117-8d4a-4cc4-ac07-83961d7fe275 None None] [instance: d0b702ab-bc03-49c0-9ae6-376e9276f717] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:13:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:13:55 user nova-compute[71269]: INFO nova.compute.manager [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attaching volume 878b14e5-70ba-4e27-8b5d-86fe258df2e9 to /dev/vdb
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.utils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f8b91-dafb-459e-89dc-82e33f0620e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b4aff-21c0-4b1a-bf3f-d154e5a32bc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a69c3e-5665-4c17-ad75-0cbbec74430c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9814bd-8bc2-4f37-b3e9-a4ca6c4bd51e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:13:55 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:13:55 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f7edb5-a1ba-4d4f-8ed1-236081e1fdfd]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG os_brick.utils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:13:55 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating existing volume attachment record: d7f7542e-3950-4e70-b5fb-066344d77e7f {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:13:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:58 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:58 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:13:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:13:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:59 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:13:59 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkFvwSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:14:00 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:14:00 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:14:00 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b1995-31f9-47f3-b489-11d3150ee481]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:14:00 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b9a72b-dc7b-4a5d-80bf-0ed3b21e1054]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9] added
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05755a2-c400-4049-a2f4-da9af53f421c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[be93b480-302d-4d0b-8886-907329e87786]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYkFvwSd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYkFvwSd" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95728dfe-43d0-40ba-bdb0-d5b36c3de7bc]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYkFvwSd'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638f6cd-d940-4dc6-b1ac-307e24cc89e5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f43ea-1f2d-4ce6-b373-150b28da6f7a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6148d-e3e6-4d84-921c-7d7abf7c20f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260]
Apr 13 23:14:00 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260] successful.
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c3b4b-29be-4e22-a818-0ea8e944b00f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f989757-fe77-422d-a2b7-805551af200e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)
Apr 13 23:14:00 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538b078-3daa-4d27-bd1c-7e84228dd3d8]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:14:00 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkFvwSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23034343165373233', 'path': '/dev/sde'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343165373233', 'path': '/dev/sde'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG nova.objects.instance [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:14:01 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:14:01 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:14:01 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:14:01 user nova-compute[71269]:   <serial>878b14e5-70ba-4e27-8b5d-86fe258df2e9</serial>
Apr 13 23:14:01 user nova-compute[71269]: </disk>
Apr 13 23:14:01 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:01 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No VIF found with MAC fa:16:3e:80:4c:a0, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-a13741bf-4a30-4ce8-ad58-a457045f645f tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.753s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:02 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:03 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:14:03 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:14:03 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8286MB free_disk=25.83513641357422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:04 user nova-compute[71269]: INFO nova.compute.manager [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Detaching volume 878b14e5-70ba-4e27-8b5d-86fe258df2e9
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:14:04 user nova-compute[71269]: INFO nova.virt.block_device [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attempting to driver detach volume 878b14e5-70ba-4e27-8b5d-86fe258df2e9 from mountpoint /dev/vdb
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Attempting to detach device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:14:04 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:14:04 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:14:04 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:14:04 user nova-compute[71269]:   <serial>878b14e5-70ba-4e27-8b5d-86fe258df2e9</serial>
Apr 13 23:14:04 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:14:04 user nova-compute[71269]: </disk>
Apr 13 23:14:04 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config.
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:14:04 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:14:04 user nova-compute[71269]:   <source dev="/dev/sde"/>
Apr 13 23:14:04 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:14:04 user nova-compute[71269]:   <serial>878b14e5-70ba-4e27-8b5d-86fe258df2e9</serial>
Apr 13 23:14:04 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:14:04 user nova-compute[71269]: </disk>
Apr 13 23:14:04 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427644.8427567, 9de39303-da44-47ae-adef-ff80f0b792a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:14:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config.
Apr 13 23:14:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkFvwSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:14:04 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e86497-2c6f-4489-852b-966bdf6446b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:14:04 user nova-compute[71269]: No targets found.
Apr 13 23:14:04 user nova-compute[71269]: iSNS:
Apr 13 23:14:04 user nova-compute[71269]: No targets found.
Apr 13 23:14:04 user nova-compute[71269]: STATIC:
Apr 13 23:14:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:14:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2
Apr 13 23:14:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:14:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:04 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9
Apr 13 23:14:04 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:04 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:04 user nova-compute[71269]: FIRMWARE:
Apr 13 23:14:04 user nova-compute[71269]: No targets found.
Apr 13 23:14:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:14:04 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:14:04 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f51ac25-a0ad-4ab0-a9b2-6045df9ae6fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc1008a-4c8f-43cb-a20d-59891b4ec675]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 (non-flash)
Apr 13 23:14:04 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9'): ({'sde'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Removing single pathed devices sde {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[54344764-ef92-41b2-8065-e031c44adf46]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d663791b-f123-44b8-b7af-f6b246485abc]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flushing IO for device /dev/sde {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf367abb-4196-4f11-b031-0ff535df4aea]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879eddc-f432-4171-ad2d-9efa5b449901]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] SCSI volumes sde have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[793cd721-9cae-45a0-8325-ec52e4e9e908]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bdfccb-3f07-4e1b-81b4-2f294ede138d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260]
Apr 13 23:14:05 user nova-compute[71269]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9, portal: 172.16.0.220,3260] successful.
Apr 13 23:14:05 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878b14e5-70ba-4e27-8b5d-86fe258df2e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c655e684-c10d-4202-913b-8c0f8dc1ed4d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== disconnect_volume: return (377ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:14:05 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:14:06 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d9a4b952-2f79-4cff-8e40-cd11b4dacafb tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.919s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:06 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [{"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:14:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-31ec73b0-9b2a-4fc1-be85-4179075afdb8" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:14:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:14:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:08 user nova-compute[71269]: INFO nova.compute.manager [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Detaching volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:14:08 user nova-compute[71269]: INFO nova.virt.block_device [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attempting to driver detach volume 3e6ecd5a-e404-40a1-b361-bb3f3c3644ac from mountpoint /dev/vdb
Apr 13 23:14:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Attempting to detach device vdb from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:14:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:14:08 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:14:08 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:14:08 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:14:08 user nova-compute[71269]:   <serial>3e6ecd5a-e404-40a1-b361-bb3f3c3644ac</serial>
Apr 13 23:14:08 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:14:08 user nova-compute[71269]: </disk>
Apr 13 23:14:08 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:14:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:14:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully detached device vdb from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the persistent domain config.
Apr 13 23:14:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:14:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:14:08 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:14:08 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:14:08 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:14:08 user nova-compute[71269]:   <serial>3e6ecd5a-e404-40a1-b361-bb3f3c3644ac</serial>
Apr 13 23:14:08 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:14:08 user nova-compute[71269]: </disk>
Apr 13 23:14:08 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:14:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427650.2913208, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:14:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully detached device vdb from instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d from the live domain config.
Apr 13 23:14:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBlySrDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:14:10 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.130s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776ba59-a220-42e3-b6d8-05c63ba6a3ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:14:10 user nova-compute[71269]: No targets found.
Apr 13 23:14:10 user nova-compute[71269]: iSNS:
Apr 13 23:14:10 user nova-compute[71269]: No targets found.
Apr 13 23:14:10 user nova-compute[71269]: STATIC:
Apr 13 23:14:10 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac
Apr 13 23:14:10 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:10 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:10 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2
Apr 13 23:14:10 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:10 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:10 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:14:10 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:14:10 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:14:10 user nova-compute[71269]: FIRMWARE:
Apr 13 23:14:10 user nova-compute[71269]: No targets found.
Apr 13 23:14:10 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:14:10 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:14:10 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[55293442-59af-41ca-bceb-da1cf12319d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b494b8db-4206-42ce-9d72-0760367fd195]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:10 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:10 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:10 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:14:10 user nova-compute[71269]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac (non-flash)
Apr 13 23:14:10 user nova-compute[71269]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef72f38-6ecf-469a-a8b7-94131fa91bd2 (non-flash)
Apr 13 23:14:10 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc3cfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba0a52-d80e-4520-bdba-0e6f66ca7348]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c479c-fa5b-4491-bfc0-8e01330dbea3]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.033s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c1711-06bb-4358-bcf8-f5408778c06b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:14:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.382s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee1100-ee26-4415-b938-173ce9068aad]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b85183-1a04-4126-a15c-39c936df0214]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[904932d2-a1cc-41e9-9620-7b02216d7800]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260]
Apr 13 23:14:11 user nova-compute[71269]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac, portal: 172.16.0.220,3260] successful.
Apr 13 23:14:11 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6ecd5a-e404-40a1-b361-bb3f3c3644ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a72b6f8-f8da-4c10-a9b7-30fe7d9e1b3d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.873s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (875ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:14:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:14:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'flavor' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-21958437-41b0-4a54-aaa6-5c60f5cb5a97 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.583s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:26 user nova-compute[71269]: INFO nova.compute.manager [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Terminating instance
Apr 13 23:14:26 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-unplugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] No waiting events found dispatching network-vif-unplugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG nova.compute.manager [req-6f024a7d-fb51-4d92-884f-e4f7997e1b91 req-d80408c5-fff2-4aad-8108-c52d7f64c4a2 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-unplugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Instance destroyed successfully.
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1404772141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1404772141',id=30,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:05:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-0iplzc78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:07:01Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=2d3ba9dd-fe6a-4d41-baab-9683ce65eb57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "address": "fa:16:3e:82:14:cb", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8177896-73", "ovs_interfaceid": "d8177896-73ec-435e-8d3d-b468a1bf47a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG os_vif [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8177896-73, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:14:27 user nova-compute[71269]: INFO os_vif [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:14:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8177896-73ec-435e-8d3d-b468a1bf47a4,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8177896-73')
Apr 13 23:14:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Deleting instance files /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57_del
Apr 13 23:14:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Deletion of /opt/stack/data/nova/instances/2d3ba9dd-fe6a-4d41-baab-9683ce65eb57_del complete
Apr 13 23:14:27 user nova-compute[71269]: INFO nova.compute.manager [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 13 23:14:27 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:14:27 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Took 0.49 seconds to deallocate network for instance.
Apr 13 23:14:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:28 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Deleted allocations for instance 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57
Apr 13 23:14:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7d3cfcd2-1079-4371-8145-03f97726a41a tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Acquiring lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] Lock "2d3ba9dd-fe6a-4d41-baab-9683ce65eb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] No waiting events found dispatching network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:14:28 user nova-compute[71269]: WARNING nova.compute.manager [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received unexpected event network-vif-plugged-d8177896-73ec-435e-8d3d-b468a1bf47a4 for instance with vm_state deleted and task_state None.
Apr 13 23:14:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-1386ed73-ff6c-4dbf-b830-2c766eef9de3 req-a1112004-057d-484c-a6f6-b27b00330ca6 service nova] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Received event network-vif-deleted-d8177896-73ec-435e-8d3d-b468a1bf47a4 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:14:40 user nova-compute[71269]: INFO nova.compute.claims [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Claim successful on node user
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:14:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.policy [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a1420e7febd479e8f23ad9784950f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cebfec442634e41b173904833269463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:14:40 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Creating image(s)
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "/opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "/opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "/opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.156s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:40 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.266s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk 1073741824" returned: 0 in 0.049s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.127s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Successfully created port: 5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Cannot resize image /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'migration_context' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Ensure instance console log exists: /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Successfully updated port: 5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquired lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-changed-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Refreshing instance network info cache due to event network-changed-5d213358-47f2-4420-be2b-8b4e69421009. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Acquiring lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427667.1733499, 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:14:42 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] VM Stopped (Lifecycle Event)
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4100dfd1-8853-4478-934e-8494f84bf152 None None] [instance: 2d3ba9dd-fe6a-4d41-baab-9683ce65eb57] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Updating instance_info_cache with network_info: [{"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Releasing lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Instance network_info: |[{"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Acquired lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Refreshing network info cache for port 5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Start _get_guest_xml network_info=[{"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:14:42 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:14:42 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1764780472',display_name='tempest-VolumesSnapshotTestJSON-instance-1764780472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1764780472',id=40,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-80tdkiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:14:41Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=08e157a4-85f9-466f-b02c-fd0fc629b302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.objects.instance [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'pci_devices' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:14:42 user nova-compute[71269]:   <uuid>08e157a4-85f9-466f-b02c-fd0fc629b302</uuid>
Apr 13 23:14:42 user nova-compute[71269]:   <name>instance-00000028</name>
Apr 13 23:14:42 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:14:42 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:14:42 user nova-compute[71269]:   <metadata>
Apr 13 23:14:42 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:14:42 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1764780472</nova:name>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:14:42</nova:creationTime>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:14:42 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:14:42 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:owner>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:user uuid="5a1420e7febd479e8f23ad9784950f65">tempest-VolumesSnapshotTestJSON-1344748200-project-member</nova:user>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:project uuid="5cebfec442634e41b173904833269463">tempest-VolumesSnapshotTestJSON-1344748200</nova:project>
Apr 13 23:14:42 user nova-compute[71269]:       </nova:owner>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:14:42 user nova-compute[71269]:       <nova:ports>
Apr 13 23:14:42 user nova-compute[71269]:         <nova:port uuid="5d213358-47f2-4420-be2b-8b4e69421009">
Apr 13 23:14:42 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 13 23:14:42 user nova-compute[71269]:         </nova:port>
Apr 13 23:14:42 user nova-compute[71269]:       </nova:ports>
Apr 13 23:14:42 user nova-compute[71269]:     </nova:instance>
Apr 13 23:14:42 user nova-compute[71269]:   </metadata>
Apr 13 23:14:42 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:14:42 user nova-compute[71269]:     <system>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="serial">08e157a4-85f9-466f-b02c-fd0fc629b302</entry>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="uuid">08e157a4-85f9-466f-b02c-fd0fc629b302</entry>
Apr 13 23:14:42 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:14:42 user nova-compute[71269]:     </system>
Apr 13 23:14:42 user nova-compute[71269]:   </sysinfo>
Apr 13 23:14:42 user nova-compute[71269]:   <os>
Apr 13 23:14:42 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:14:42 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:14:42 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:14:42 user nova-compute[71269]:   </os>
Apr 13 23:14:42 user nova-compute[71269]:   <features>
Apr 13 23:14:42 user nova-compute[71269]:     <acpi/>
Apr 13 23:14:42 user nova-compute[71269]:     <apic/>
Apr 13 23:14:42 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:14:42 user nova-compute[71269]:   </features>
Apr 13 23:14:42 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:14:42 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:14:42 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:14:42 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:14:42 user nova-compute[71269]:   </clock>
Apr 13 23:14:42 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:14:42 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:14:42 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:14:42 user nova-compute[71269]:   </cpu>
Apr 13 23:14:42 user nova-compute[71269]:   <devices>
Apr 13 23:14:42 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:14:42 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:14:42 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk"/>
Apr 13 23:14:42 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:14:42 user nova-compute[71269]:     </disk>
Apr 13 23:14:42 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:14:42 user nova-compute[71269]:       <mac address="fa:16:3e:cd:d0:56"/>
Apr 13 23:14:42 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:14:42 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:14:42 user nova-compute[71269]:       <target dev="tap5d213358-47"/>
Apr 13 23:14:42 user nova-compute[71269]:     </interface>
Apr 13 23:14:42 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:14:42 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/console.log" append="off"/>
Apr 13 23:14:42 user nova-compute[71269]:     </serial>
Apr 13 23:14:42 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:14:42 user nova-compute[71269]:     <video>
Apr 13 23:14:42 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:14:42 user nova-compute[71269]:     </video>
Apr 13 23:14:42 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:14:42 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:14:42 user nova-compute[71269]:     </rng>
Apr 13 23:14:42 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:14:42 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:14:42 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:14:42 user nova-compute[71269]:     </memballoon>
Apr 13 23:14:42 user nova-compute[71269]:   </devices>
Apr 13 23:14:42 user nova-compute[71269]: </domain>
Apr 13 23:14:42 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1764780472',display_name='tempest-VolumesSnapshotTestJSON-instance-1764780472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1764780472',id=40,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-80tdkiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:14:41Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=08e157a4-85f9-466f-b02c-fd0fc629b302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG os_vif [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d213358-47, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d213358-47, col_values=(('external_ids', {'iface-id': '5d213358-47f2-4420-be2b-8b4e69421009', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:d0:56', 'vm-uuid': '08e157a4-85f9-466f-b02c-fd0fc629b302'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:42 user nova-compute[71269]: INFO os_vif [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47')
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:14:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No VIF found with MAC fa:16:3e:cd:d0:56, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:14:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Updated VIF entry in instance network info cache for port 5d213358-47f2-4420-be2b-8b4e69421009. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:14:43 user nova-compute[71269]: DEBUG nova.network.neutron [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Updating instance_info_cache with network_info: [{"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:14:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7365b789-a55d-4318-86e1-4abd56b8d19e req-4a89de03-3ec3-4fb7-9284-5a0f25f7b971 service nova] Releasing lock "refresh_cache-08e157a4-85f9-466f-b02c-fd0fc629b302" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG nova.compute.manager [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:44 user nova-compute[71269]: DEBUG nova.compute.manager [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:14:44 user nova-compute[71269]: WARNING nova.compute.manager [req-3655a0c5-8016-4c12-937d-f8ecb0e9ab61 req-d071c588-7bf3-4d4c-a56c-e40a2d1d9155 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state building and task_state spawning.
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427686.398758, 08e157a4-85f9-466f-b02c-fd0fc629b302 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] VM Resumed (Lifecycle Event)
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Instance spawned successfully.
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427686.4024415, 08e157a4-85f9-466f-b02c-fd0fc629b302 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] VM Started (Lifecycle Event)
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:14:46 user nova-compute[71269]: INFO nova.compute.manager [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Took 6.46 seconds to build instance.
Apr 13 23:14:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-2f43f86c-63ab-4a39-94fd-84e70b48a78e tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.581s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:14:46 user nova-compute[71269]: WARNING nova.compute.manager [req-63ce3a16-24f4-4d4e-9494-f62e14271303 req-0ee7df39-e68d-4c33-a851-6ba69fe2c4d2 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state active and task_state None.
Apr 13 23:14:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:14:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG nova.objects.instance [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:14:58 user nova-compute[71269]: INFO nova.compute.manager [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attaching volume 72fc9050-a147-486d-87e7-d38a17c5bd4d to /dev/vdb
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.utils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d8ae3f-c06f-405f-a1a7-4113a490459b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f099397e-634f-47aa-89ee-03e19e8f5cba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2344a2e7-597c-42be-8bb2-12fe8f1ee950]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94cbc2-2787-42bd-8f6e-9d6234e221b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:14:58 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:14:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9e51c-4e16-45f4-94f7-291a8639cc31]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG os_brick.utils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:14:58 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating existing volume attachment record: 4889b782-9fcd-463d-8bfd-48b73592559e {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:14:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznCXBrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:15:03 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:15:03 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:15:03 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4b0a8-9733-4bab-bbe6-0bb07376e9a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:15:03 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c505da-ad47-436b-8c99-741863516abd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d] added
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ef6a6-105f-43dd-8b12-08ebe0d8f3a9]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be56d1-214e-419d-92ee-887868ce1986]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JznCXBrD {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JznCXBrD" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988283f-5d33-45bd-a1f0-6f9e7f3becf3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JznCXBrD'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98f192-07f5-477b-ab1a-ab2da1549d52]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded58da-fd15-43bd-bdd1-f7ece9e1f6df]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7dc014-024b-484d-99a0-02a029c982ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260]
Apr 13 23:15:03 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260] successful.
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db51c7-d1f1-4017-9ff7-1bd7482cee0c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7d2d1-2cb5-4ad2-8c2f-2c5faad5bde6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:03 user nova-compute[71269]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:03 user nova-compute[71269]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)
Apr 13 23:15:03 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[395bfd1d-d697-42b2-8b96-78b28bf37b9a]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznCXBrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.547s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== connect_volume: return (1549ms) {'type': 'block', 'scsi_wwn': '26562393435356333', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393435356333', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:15:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:15:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8268MB free_disk=26.227367401123047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.objects.instance [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:15:04 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:15:04 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:15:04 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:15:04 user nova-compute[71269]:   <serial>72fc9050-a147-486d-87e7-d38a17c5bd4d</serial>
Apr 13 23:15:04 user nova-compute[71269]: </disk>
Apr 13 23:15:04 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:15:04 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No VIF found with MAC fa:16:3e:80:4c:a0, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-56714bdc-768a-4c08-b4b0-fbdf289311ad tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.885s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:06 user nova-compute[71269]: INFO nova.compute.manager [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Detaching volume 72fc9050-a147-486d-87e7-d38a17c5bd4d
Apr 13 23:15:06 user nova-compute[71269]: INFO nova.virt.block_device [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attempting to driver detach volume 72fc9050-a147-486d-87e7-d38a17c5bd4d from mountpoint /dev/vdb
Apr 13 23:15:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Attempting to detach device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:15:06 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:15:06 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:15:06 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:15:06 user nova-compute[71269]:   <serial>72fc9050-a147-486d-87e7-d38a17c5bd4d</serial>
Apr 13 23:15:06 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:15:06 user nova-compute[71269]: </disk>
Apr 13 23:15:06 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:15:06 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config.
Apr 13 23:15:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:15:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:15:06 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:15:06 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:15:06 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:15:06 user nova-compute[71269]:   <serial>72fc9050-a147-486d-87e7-d38a17c5bd4d</serial>
Apr 13 23:15:06 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:15:06 user nova-compute[71269]: </disk>
Apr 13 23:15:06 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427707.1544251, 9de39303-da44-47ae-adef-ff80f0b792a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:15:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config.
Apr 13 23:15:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznCXBrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:15:07 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f12f4a-895c-472c-bf69-5057f2ce4e8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:15:07 user nova-compute[71269]: No targets found.
Apr 13 23:15:07 user nova-compute[71269]: iSNS:
Apr 13 23:15:07 user nova-compute[71269]: No targets found.
Apr 13 23:15:07 user nova-compute[71269]: STATIC:
Apr 13 23:15:07 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d
Apr 13 23:15:07 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:15:07 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:15:07 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:15:07 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:15:07 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:15:07 user nova-compute[71269]: FIRMWARE:
Apr 13 23:15:07 user nova-compute[71269]: No targets found.
Apr 13 23:15:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:15:07 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:15:07 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeccac0-b1ee-42a9-ac89-f57c4f5ebded]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7389a-f0b0-404c-ab50-12cc410d1e31]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:07 user nova-compute[71269]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)
Apr 13 23:15:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:07 user nova-compute[71269]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d (non-flash)
Apr 13 23:15:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40689ee6-dfe4-446f-b1fc-ec1f47a54131]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b342aab2-4eff-4b2c-9e82-ae13b44965e2]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eb2cab-ca49-4579-b7da-235ece81f1d2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d707b9-56ae-482f-ba70-235dbad6a994]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[256d648c-dafc-45c5-9076-cb91ed77006a]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ff67c-a063-441a-a349-0b9b115c1c51]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260]
Apr 13 23:15:07 user nova-compute[71269]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d, portal: 172.16.0.220,3260] successful.
Apr 13 23:15:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fc9050-a147-486d-87e7-d38a17c5bd4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[69131cf8-eedd-4a62-aab4-934cbd0670f4]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== disconnect_volume: return (281ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4900a6c2-080e-46d6-b9c4-b24394191743 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.781s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:15:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:15:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:15:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:16 user nova-compute[71269]: INFO nova.compute.manager [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Terminating instance
Apr 13 23:15:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.compute.manager [req-9dd661dd-f999-49bd-8070-345c6767e88f req-b185ee41-2692-49b9-8f13-5f273e37234c service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-unplugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:15:17 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Instance destroyed successfully.
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.objects.instance [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid 31ec73b0-9b2a-4fc1-be85-4179075afdb8 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343743038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343743038',id=18,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-7qxuk3m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:03:17Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=31ec73b0-9b2a-4fc1-be85-4179075afdb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "address": "fa:16:3e:34:11:5b", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1a7f33-f5", "ovs_interfaceid": "0f1a7f33-f5b1-4acf-baac-7e66a5f97d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_vif [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f1a7f33-f5, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:15:17 user nova-compute[71269]: INFO os_vif [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:11:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f1a7f33-f5b1-4acf-baac-7e66a5f97d37,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1a7f33-f5')
Apr 13 23:15:17 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPCUlxyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:15:17 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e71ae38-2832-4925-98ca-63bca5e75cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:15:17 user nova-compute[71269]: No targets found.
Apr 13 23:15:17 user nova-compute[71269]: iSNS:
Apr 13 23:15:17 user nova-compute[71269]: No targets found.
Apr 13 23:15:17 user nova-compute[71269]: STATIC:
Apr 13 23:15:17 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2
Apr 13 23:15:17 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:15:17 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:15:17 user nova-compute[71269]: FIRMWARE:
Apr 13 23:15:17 user nova-compute[71269]: No targets found.
Apr 13 23:15:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:15:17 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:15:17 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[339fc13a-099d-4faf-8d4a-b11df35f7da6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac46f7d2-33df-4487-a397-7b73013ec132]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 (non-flash)
Apr 13 23:15:17 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2'): ({'sdd'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Removing single pathed devices sdd {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[65007464-ef31-40f2-a253-162629f5067f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd564a3-0d79-433d-b07b-8eb65c9f442a]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Flushing IO for device /dev/sdd {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e54c35-320a-45ff-adf2-e5b5030d2c98]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6310f8-f7b0-414d-996d-fdefc0f68869]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] SCSI volumes sdd have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f15d9d1-7211-4f63-92f8-0f350321d1c8]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:17 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a54fe-ee69-4c82-8abd-21c5cca6c09b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260]
Apr 13 23:15:18 user nova-compute[71269]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2, portal: 172.16.0.220,3260] successful.
Apr 13 23:15:18 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8872b098-b9f8-4636-a183-7cc7ee479ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34df3c9-fc4b-41c5-9f04-b5a77ca6cd90]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] <== disconnect_volume: return (294ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:15:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Deleting instance files /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8_del
Apr 13 23:15:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Deletion of /opt/stack/data/nova/instances/31ec73b0-9b2a-4fc1-be85-4179075afdb8_del complete
Apr 13 23:15:18 user nova-compute[71269]: INFO nova.compute.manager [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 13 23:15:18 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:15:18 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:15:19 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Took 0.99 seconds to deallocate network for instance.
Apr 13 23:15:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d573510-5e0d-42e1-801c-f97c1682a597 req-8deeb360-ce2c-43c1-aeb5-7b3e9797b348 service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-deleted-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Acquiring lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] No waiting events found dispatching network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:15:19 user nova-compute[71269]: WARNING nova.compute.manager [req-a0bdb0af-62c5-480a-a4cf-1090b8b74b03 req-57fa7b64-4d78-4a0a-92f4-55ea353f0dcf service nova] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Received unexpected event network-vif-plugged-0f1a7f33-f5b1-4acf-baac-7e66a5f97d37 for instance with vm_state active and task_state deleting.
Apr 13 23:15:20 user nova-compute[71269]: INFO nova.compute.manager [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Took 0.91 seconds to detach 1 volumes for instance.
Apr 13 23:15:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:20 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:15:20 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:15:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:20 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Deleted allocations for instance 31ec73b0-9b2a-4fc1-be85-4179075afdb8
Apr 13 23:15:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-6d63a6cc-ca32-47fc-a07c-0239bbf5c9f1 tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "31ec73b0-9b2a-4fc1-be85-4179075afdb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.408s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:15:27 user nova-compute[71269]: INFO nova.compute.claims [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Claim successful on node user
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:15:27 user nova-compute[71269]: DEBUG nova.policy [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:15:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:15:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Creating image(s)
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "/opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "/opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "/opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk 1073741824" returned: 0 in 0.110s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Successfully created port: 319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Cannot resize image /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'migration_context' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Ensure instance console log exists: /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Successfully updated port: 319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing instance network info cache due to event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.neutron [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Instance network_info: |[{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Start _get_guest_xml network_info=[{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:15:29 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:15:29 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1291739265',display_name='tempest-TestStampPattern-server-1291739265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1291739265',id=41,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-ova767sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:15:28Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=f522c0be-7d51-421c-8d6c-d01ce6f6eb26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.objects.instance [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'pci_devices' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:15:29 user nova-compute[71269]:   <uuid>f522c0be-7d51-421c-8d6c-d01ce6f6eb26</uuid>
Apr 13 23:15:29 user nova-compute[71269]:   <name>instance-00000029</name>
Apr 13 23:15:29 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:15:29 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:15:29 user nova-compute[71269]:   <metadata>
Apr 13 23:15:29 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:15:29 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:name>tempest-TestStampPattern-server-1291739265</nova:name>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:15:29</nova:creationTime>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:15:29 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:15:29 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:owner>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:user uuid="17551363dd9f4e219ad7198b21509e48">tempest-TestStampPattern-1517924890-project-member</nova:user>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:project uuid="a71645bbbfcc4e41994fe910043ca0dd">tempest-TestStampPattern-1517924890</nova:project>
Apr 13 23:15:29 user nova-compute[71269]:       </nova:owner>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:15:29 user nova-compute[71269]:       <nova:ports>
Apr 13 23:15:29 user nova-compute[71269]:         <nova:port uuid="319f1294-7d2b-4725-8ecd-a21ef3df06e8">
Apr 13 23:15:29 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:15:29 user nova-compute[71269]:         </nova:port>
Apr 13 23:15:29 user nova-compute[71269]:       </nova:ports>
Apr 13 23:15:29 user nova-compute[71269]:     </nova:instance>
Apr 13 23:15:29 user nova-compute[71269]:   </metadata>
Apr 13 23:15:29 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:15:29 user nova-compute[71269]:     <system>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="serial">f522c0be-7d51-421c-8d6c-d01ce6f6eb26</entry>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="uuid">f522c0be-7d51-421c-8d6c-d01ce6f6eb26</entry>
Apr 13 23:15:29 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:15:29 user nova-compute[71269]:     </system>
Apr 13 23:15:29 user nova-compute[71269]:   </sysinfo>
Apr 13 23:15:29 user nova-compute[71269]:   <os>
Apr 13 23:15:29 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:15:29 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:15:29 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:15:29 user nova-compute[71269]:   </os>
Apr 13 23:15:29 user nova-compute[71269]:   <features>
Apr 13 23:15:29 user nova-compute[71269]:     <acpi/>
Apr 13 23:15:29 user nova-compute[71269]:     <apic/>
Apr 13 23:15:29 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:15:29 user nova-compute[71269]:   </features>
Apr 13 23:15:29 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:15:29 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:15:29 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:15:29 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:15:29 user nova-compute[71269]:   </clock>
Apr 13 23:15:29 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:15:29 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:15:29 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:15:29 user nova-compute[71269]:   </cpu>
Apr 13 23:15:29 user nova-compute[71269]:   <devices>
Apr 13 23:15:29 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:15:29 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:15:29 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk"/>
Apr 13 23:15:29 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:15:29 user nova-compute[71269]:     </disk>
Apr 13 23:15:29 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:15:29 user nova-compute[71269]:       <mac address="fa:16:3e:49:ba:a6"/>
Apr 13 23:15:29 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:15:29 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:15:29 user nova-compute[71269]:       <target dev="tap319f1294-7d"/>
Apr 13 23:15:29 user nova-compute[71269]:     </interface>
Apr 13 23:15:29 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:15:29 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/console.log" append="off"/>
Apr 13 23:15:29 user nova-compute[71269]:     </serial>
Apr 13 23:15:29 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:15:29 user nova-compute[71269]:     <video>
Apr 13 23:15:29 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:15:29 user nova-compute[71269]:     </video>
Apr 13 23:15:29 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:15:29 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:15:29 user nova-compute[71269]:     </rng>
Apr 13 23:15:29 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:15:29 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:15:29 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:15:29 user nova-compute[71269]:     </memballoon>
Apr 13 23:15:29 user nova-compute[71269]:   </devices>
Apr 13 23:15:29 user nova-compute[71269]: </domain>
Apr 13 23:15:29 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1291739265',display_name='tempest-TestStampPattern-server-1291739265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1291739265',id=41,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-ova767sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:15:28Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=f522c0be-7d51-421c-8d6c-d01ce6f6eb26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG os_vif [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap319f1294-7d, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap319f1294-7d, col_values=(('external_ids', {'iface-id': '319f1294-7d2b-4725-8ecd-a21ef3df06e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ba:a6', 'vm-uuid': 'f522c0be-7d51-421c-8d6c-d01ce6f6eb26'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:29 user nova-compute[71269]: INFO os_vif [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d')
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:15:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No VIF found with MAC fa:16:3e:49:ba:a6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:15:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updated VIF entry in instance network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:15:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:15:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-db5abe01-4ba8-4013-884a-862769855c0b req-49b5c565-36c2-4680-a13a-4aefba21edff service nova] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] No waiting events found dispatching network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:15:31 user nova-compute[71269]: WARNING nova.compute.manager [req-cd0002ab-c7ce-4ef5-a6ac-9f55541c9967 req-69e1cd34-42d8-446c-b9e2-6713acbdb3c2 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received unexpected event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance with vm_state building and task_state spawning.
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:32 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427717.7229664, 31ec73b0-9b2a-4fc1-be85-4179075afdb8 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:15:32 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] VM Stopped (Lifecycle Event)
Apr 13 23:15:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-a20086e5-e56d-41cb-983d-72170dc63b27 None None] [instance: 31ec73b0-9b2a-4fc1-be85-4179075afdb8] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] No waiting events found dispatching network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:15:33 user nova-compute[71269]: WARNING nova.compute.manager [req-9f86cd2c-48cd-47bb-bb32-03728abb4a25 req-b95a0445-269a-43e5-94da-5f3df9384da9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received unexpected event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance with vm_state building and task_state spawning.
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427733.7573087, f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] VM Resumed (Lifecycle Event)
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Instance spawned successfully.
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427733.7588003, f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] VM Started (Lifecycle Event)
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 13 23:15:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:15:33 user nova-compute[71269]: INFO nova.compute.manager [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Took 6.47 seconds to build instance.
Apr 13 23:15:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-9a6cae12-59c4-45f4-9880-e095c2c0a888 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.576s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:15:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:15:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG nova.objects.instance [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:00 user nova-compute[71269]: INFO nova.compute.manager [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attaching volume a9e6f0a5-ac9a-43c7-aebd-a4784595f319 to /dev/vdb
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG os_brick.utils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f30bc-e699-4957-82e2-1c15dd86acc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e58ab1-c96b-43a7-a41d-318b19836e92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:00 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a46a09-8f7e-4534-ac4b-5a0f6dd82c12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fc488-f7bc-45b7-a24a-5f1a3d7a64c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:01 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabee1cf-d531-459a-bbc2-78affafd8008]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.utils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating existing volume attachment record: 620b984f-2947-46c6-b7f6-802a7620ecc4 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'flavor' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:01 user nova-compute[71269]: INFO nova.compute.manager [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attaching volume ef4e4a35-555c-4395-acaf-17e3d7446b18 to /dev/vdb
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.utils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7503a186-4774-497a-8f9a-4688a085525f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e8d8e-7d84-42ce-8659-caf139f91bf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb7f35-8ceb-462e-acf2-4cf5679ad52e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58f7f3-5644-4f89-98c8-160fd06c49ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:01 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b129be7-385c-4197-8d09-810f60c8a543]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG os_brick.utils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating existing volume attachment record: 5b51ce15-46f4-40bc-adf4-bfed9c6097dd {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:16:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:02 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:02 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:03 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:16:04 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:16:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=26.196041107177734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 08e157a4-85f9-466f-b02c-fd0fc629b302 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeoudzxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:05 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:05 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:05 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8245ce84-9ea3-4f5d-8957-5c970d3a9211]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:16:05 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ac27c-209b-433f-b6d8-510715e8cd29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319] added
Apr 13 23:16:05 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04079a-9804-4e22-89e8-261d48eba2a5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d1b834-f432-46d5-b746-20f210a1c989]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZeoudzxH {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZeoudzxH" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740f14d-169d-424c-8515-00eff0a9f4fd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZeoudzxH'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a66bd2-ddab-400d-bd29-562200e5d527]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875ece9-8481-4090-b2aa-dda793dece6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:16:05 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:16:05 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:05 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 23:16:05 user nova-compute[71269]: 
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3412d2-c527-4026-bffc-7e3a58faf349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260]
Apr 13 23:16:05 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:05 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9303a-b3e6-4d07-8f61-147c28915064]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b866ed9-9e6b-4ab7-854f-bf8a63d66f52]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:05 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:05 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa7276a-69b9-4014-b2de-a71bf5222aab]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeoudzxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:05 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:05 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23235303737663633', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303737663633', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.773s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:06 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:06 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG nova.objects.instance [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5f474-e3b6-46f9-9818-ff9db18cec32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:16:06 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:16:06 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:06 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:16:06 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:06 user nova-compute[71269]:   <serial>a9e6f0a5-ac9a-43c7-aebd-a4784595f319</serial>
Apr 13 23:16:06 user nova-compute[71269]: </disk>
Apr 13 23:16:06 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d2690-157b-4e54-8b9e-b796f72b448c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added
Apr 13 23:16:06 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e932f30-011d-452c-9704-59962fb0211f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[41841142-076e-4d62-ba18-724e351e5ae0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3370e-bcc2-478f-b944-8f59dbf51542]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzpRBCtF'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c3eee-305a-4c29-bc5b-164b7ae8d09f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da0122-c83e-4cdf-8c0c-324eb28853d0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:06 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:06 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b73a27-d5fa-44fc-a2dc-62c0f32ab2b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:16:06 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:06 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ebb605-3012-4be0-8ff8-744f95fb68de]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f0bfa-c951-4d56-901a-ea93ddc77635]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:07 user nova-compute[71269]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:07 user nova-compute[71269]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:07 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71fdfb7-d8bb-4a8c-8611-57e495d88881]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] No VIF found with MAC fa:16:3e:80:4c:a0, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-880c2a79-e806-4f79-9e22-8d63642a2dc3 tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.533s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:07 user nova-compute[71269]: INFO nova.compute.manager [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Terminating instance
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-unplugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] No waiting events found dispatching network-vif-unplugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:07 user nova-compute[71269]: DEBUG nova.compute.manager [req-d5aee83e-c71a-4b3e-8a4b-097b372483fd req-d257e547-c4ca-471b-87d9-42d0c923e8af service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-unplugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (2100ms) {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'flavor' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:16:08 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:08 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:16:08 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:08 user nova-compute[71269]:   <serial>ef4e4a35-555c-4395-acaf-17e3d7446b18</serial>
Apr 13 23:16:08 user nova-compute[71269]: </disk>
Apr 13 23:16:08 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Instance destroyed successfully.
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lazy-loading 'resources' on Instance uuid 7226cc11-4c2c-4a27-bb02-87ba1f749d33 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T22:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1319911046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1319911046',id=13,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T22:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fe77a2c491c4596ba7e6af3236d7de8',ramdisk_id='',reservation_id='r-3t8pam19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T22:58:29Z,user_data=None,user_id='6db44e7cb89a46c2999916b0a266b159',uuid=7226cc11-4c2c-4a27-bb02-87ba1f749d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converting VIF {"id": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "address": "fa:16:3e:23:2c:2d", "network": {"id": "7ea834aa-c724-45fb-9c3f-497360beab67", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-319317817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fe77a2c491c4596ba7e6af3236d7de8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefcee78-4e", "ovs_interfaceid": "eefcee78-4e09-44b9-ad0c-7b7ee693a6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG os_vif [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeefcee78-4e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:16:08 user nova-compute[71269]: INFO os_vif [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:2c:2d,bridge_name='br-int',has_traffic_filtering=True,id=eefcee78-4e09-44b9-ad0c-7b7ee693a6fb,network=Network(7ea834aa-c724-45fb-9c3f-497360beab67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefcee78-4e')
Apr 13 23:16:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Deleting instance files /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33_del
Apr 13 23:16:08 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Deletion of /opt/stack/data/nova/instances/7226cc11-4c2c-4a27-bb02-87ba1f749d33_del complete
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:23:cf:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:16:08 user nova-compute[71269]: INFO nova.compute.manager [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 13 23:16:08 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:16:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8619c21c-0ae7-4f50-9867-9a7db8b14c22 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.422s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.compute.manager [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Detaching volume a9e6f0a5-ac9a-43c7-aebd-a4784595f319
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Took 0.48 seconds to deallocate network for instance.
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.virt.block_device [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Attempting to driver detach volume a9e6f0a5-ac9a-43c7-aebd-a4784595f319 from mountpoint /dev/vdb
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.compute.manager [req-edbba771-4712-4397-ba1d-b06a1133d6b4 req-b674b1e0-6594-434d-a37b-3930fd954a38 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-deleted-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Attempting to detach device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:16:09 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:09 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:16:09 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:09 user nova-compute[71269]:   <serial>a9e6f0a5-ac9a-43c7-aebd-a4784595f319</serial>
Apr 13 23:16:09 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:16:09 user nova-compute[71269]: </disk>
Apr 13 23:16:09 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the persistent domain config.
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:16:09 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:09 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:16:09 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:09 user nova-compute[71269]:   <serial>a9e6f0a5-ac9a-43c7-aebd-a4784595f319</serial>
Apr 13 23:16:09 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:16:09 user nova-compute[71269]: </disk>
Apr 13 23:16:09 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Deleted allocations for instance 7226cc11-4c2c-4a27-bb02-87ba1f749d33
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-651f4595-f8fb-489f-aa93-3cb455dd13ad tempest-ServerBootFromVolumeStableRescueTest-1416841836 tempest-ServerBootFromVolumeStableRescueTest-1416841836-project-member] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427769.724723, 9de39303-da44-47ae-adef-ff80f0b792a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:16:09 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully detached device vdb from instance 9de39303-da44-47ae-adef-ff80f0b792a7 from the live domain config.
Apr 13 23:16:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeoudzxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:09 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32470f-a9fc-4deb-9707-b1a819ba4ba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:16:09 user nova-compute[71269]: No targets found.
Apr 13 23:16:09 user nova-compute[71269]: iSNS:
Apr 13 23:16:09 user nova-compute[71269]: No targets found.
Apr 13 23:16:09 user nova-compute[71269]: STATIC:
Apr 13 23:16:09 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:16:09 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:09 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:09 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319
Apr 13 23:16:09 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:09 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:09 user nova-compute[71269]: FIRMWARE:
Apr 13 23:16:09 user nova-compute[71269]: No targets found.
Apr 13 23:16:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:16:09 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:16:09 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cc4b04-0041-4cc2-9547-a293e9cfdb35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11b2e7-f96e-459b-bdce-613011e07d44]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:09 user nova-compute[71269]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 (non-flash)
Apr 13 23:16:09 user nova-compute[71269]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c68ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d488bd-92fa-45e7-ac82-cb79b74a1c08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dadcea-f009-49b7-82ba-b69a99f8abaa]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15999917-4f7e-45c6-9708-7fe2fd930390]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c24eb6-be78-4681-8576-27cbd78fce44]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7217ab62-0226-40cd-bc95-2c2606cb9452]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e51b1-178d-44cd-8c5f-928f692b3c22]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260]
Apr 13 23:16:10 user nova-compute[71269]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:10 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e6f0a5-ac9a-43c7-aebd-a4784595f319 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56565f4-5fa8-4164-8d22-ac5b43fcb437]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] <== disconnect_volume: return (298ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Acquiring lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] Lock "7226cc11-4c2c-4a27-bb02-87ba1f749d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] No waiting events found dispatching network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:10 user nova-compute[71269]: WARNING nova.compute.manager [req-d2259c85-8c19-4f95-a171-f4397e22feba req-2c45bcdd-e7db-49ed-a190-24a288db7071 service nova] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Received unexpected event network-vif-plugged-eefcee78-4e09-44b9-ad0c-7b7ee693a6fb for instance with vm_state deleted and task_state None.
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Stashing vm_state: active {{(pid=71269) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_requests' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:16:10 user nova-compute[71269]: INFO nova.compute.claims [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Claim successful on node user
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:10 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating resource usage from migration 8aa0c956-873f-4f54-ad88-fb8d5fe4ac0c
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'flavor' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.302s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:10 user nova-compute[71269]: INFO nova.compute.manager [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Migrating
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:16:10 user nova-compute[71269]: INFO nova.compute.rpcapi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1fe0f25d-d3f5-4e2e-9c48-697d95dab6ea tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.907s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:16:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Starting migrate_disk_and_power_off {{(pid=71269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:12 user nova-compute[71269]: WARNING nova.compute.manager [req-2fbc7153-44fd-4ef0-90f4-f7f814514b4a req-1f4ce3a6-5f7b-4b55-b073-12c3d6c14f49 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state resize_migrating.
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance destroyed successfully.
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09cc0c17-bd, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:12 user nova-compute[71269]: INFO os_vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c96da7-993e-41d2-a8b3-65d9bc8ed7fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:16:12 user nova-compute[71269]: No targets found.
Apr 13 23:16:12 user nova-compute[71269]: iSNS:
Apr 13 23:16:12 user nova-compute[71269]: No targets found.
Apr 13 23:16:12 user nova-compute[71269]: STATIC:
Apr 13 23:16:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:16:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:12 user nova-compute[71269]: FIRMWARE:
Apr 13 23:16:12 user nova-compute[71269]: No targets found.
Apr 13 23:16:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:16:12 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:16:12 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aae578-3ef7-4be7-a004-ab10b3c8794f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8393d677-e980-4e58-a268-b3f91bd3bec3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c1b72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a45b3-d1fc-446e-8c02-ca673537f396]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e7649-b78a-42f0-bf4b-8d3a58ad140e]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8debbf-64c9-4765-9148-9f176c01a533]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa891b9-dd52-47e1-a1e5-f394b3585acb]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724511c-4f79-4114-bc26-bffb36af887c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a94e2cd-aa1b-4156-baa0-f3b0ef53c70f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:16:12 user nova-compute[71269]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[059bf6e4-6e74-4c90-b419-ce6e00219c13]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (296ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:16:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_resize/disk /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "cp -r /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_resize/disk /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk" returned: 0 in 0.280s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_resize/disk.info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "cp -r /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_resize/disk.info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk.info" returned: 0 in 0.040s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:14 user nova-compute[71269]: WARNING nova.compute.manager [req-681d4392-aded-474a-bf45-685e984208c2 req-1e0ca2e2-eb88-4a2c-a6d7-93abf36280d3 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state resize_migrating.
Apr 13 23:16:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Port 09cc0c17-bd49-4207-9de4-89178a1e681e binding to destination host user is already ACTIVE {{(pid=71269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:16:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.utils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb16b59c-73d7-4db7-8e52-751263b6f30e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[337fdc53-db1e-45e7-9b40-95619c2c503a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d548711-6b23-4ecc-94ec-cbb809be2455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c8b7c6-cfa3-442c-a05d-95abeaaae16b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:15 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:16:15 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9006b86-940a-4de4-93d8-e6f168852714]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:16:15 user nova-compute[71269]: DEBUG os_brick.utils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Starting finish_migration {{(pid=71269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 23:16:19 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating image(s)
Apr 13 23:16:19 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:16:19 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Cannot resize image /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start _get_guest_xml network_info=[{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0c5221ca-3c66-4c45-b2af-cb87598e2b12', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d', 'attached_at': '2023-04-13T23:16:20.000000', 'detached_at': '', 'volume_id': 'ef4e4a35-555c-4395-acaf-17e3d7446b18', 'serial': 'ef4e4a35-555c-4395-acaf-17e3d7446b18'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:16:20 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:16:20 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:20 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:20 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:20 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36fa080-1407-4a41-aa72-476ea4658bef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:16:20 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96277d8-897f-4bf8-ab25-8ddc0fa493e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added
Apr 13 23:16:20 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1ed42-033e-474b-8830-c609b6f0096e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f1ef1-3e5a-43d5-8991-9a8b7bdf5aff]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195eaea-8b33-46cc-a7eb-4428f0bbfed7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzpRBCtF'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4996e-c5ac-46f9-bf52-90f410d32818]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bc1cd-5b86-425b-b88a-63c8e6176bb8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:16:20 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:16:20 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:20 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 23:16:20 user nova-compute[71269]: 
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd937e3-f560-4cf5-a10a-54095adb5fec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:16:20 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:20 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f13ef-25ac-4905-b846-8e703087a977]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e57e82c-c912-4ff5-8283-d33c8b9def2d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:20 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:20 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1779d4-9bec-478c-815a-a0a616d3da9e]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:20 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:16:21 user nova-compute[71269]:   <uuid>d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</uuid>
Apr 13 23:16:21 user nova-compute[71269]:   <name>instance-00000021</name>
Apr 13 23:16:21 user nova-compute[71269]:   <memory>196608</memory>
Apr 13 23:16:21 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:16:21 user nova-compute[71269]:   <metadata>
Apr 13 23:16:21 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:16:21 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-19843969</nova:name>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:16:20</nova:creationTime>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:flavor name="m1.micro">
Apr 13 23:16:21 user nova-compute[71269]:         <nova:memory>192</nova:memory>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:16:21 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:owner>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:16:21 user nova-compute[71269]:       </nova:owner>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:16:21 user nova-compute[71269]:       <nova:ports>
Apr 13 23:16:21 user nova-compute[71269]:         <nova:port uuid="09cc0c17-bd49-4207-9de4-89178a1e681e">
Apr 13 23:16:21 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:16:21 user nova-compute[71269]:         </nova:port>
Apr 13 23:16:21 user nova-compute[71269]:       </nova:ports>
Apr 13 23:16:21 user nova-compute[71269]:     </nova:instance>
Apr 13 23:16:21 user nova-compute[71269]:   </metadata>
Apr 13 23:16:21 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:16:21 user nova-compute[71269]:     <system>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="serial">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="uuid">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:16:21 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:16:21 user nova-compute[71269]:     </system>
Apr 13 23:16:21 user nova-compute[71269]:   </sysinfo>
Apr 13 23:16:21 user nova-compute[71269]:   <os>
Apr 13 23:16:21 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:16:21 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:16:21 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:16:21 user nova-compute[71269]:   </os>
Apr 13 23:16:21 user nova-compute[71269]:   <features>
Apr 13 23:16:21 user nova-compute[71269]:     <acpi/>
Apr 13 23:16:21 user nova-compute[71269]:     <apic/>
Apr 13 23:16:21 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:16:21 user nova-compute[71269]:   </features>
Apr 13 23:16:21 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:16:21 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:16:21 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:16:21 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:16:21 user nova-compute[71269]:   </clock>
Apr 13 23:16:21 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:16:21 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:16:21 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:16:21 user nova-compute[71269]:   </cpu>
Apr 13 23:16:21 user nova-compute[71269]:   <devices>
Apr 13 23:16:21 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:16:21 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:16:21 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk"/>
Apr 13 23:16:21 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:16:21 user nova-compute[71269]:     </disk>
Apr 13 23:16:21 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:16:21 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:21 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:16:21 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:16:21 user nova-compute[71269]:       <serial>ef4e4a35-555c-4395-acaf-17e3d7446b18</serial>
Apr 13 23:16:21 user nova-compute[71269]:     </disk>
Apr 13 23:16:21 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:16:21 user nova-compute[71269]:       <mac address="fa:16:3e:23:cf:d9"/>
Apr 13 23:16:21 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:16:21 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:16:21 user nova-compute[71269]:       <target dev="tap09cc0c17-bd"/>
Apr 13 23:16:21 user nova-compute[71269]:     </interface>
Apr 13 23:16:21 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:16:21 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log" append="off"/>
Apr 13 23:16:21 user nova-compute[71269]:     </serial>
Apr 13 23:16:21 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:16:21 user nova-compute[71269]:     <video>
Apr 13 23:16:21 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:16:21 user nova-compute[71269]:     </video>
Apr 13 23:16:21 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:16:21 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:16:21 user nova-compute[71269]:     </rng>
Apr 13 23:16:21 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:16:21 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:16:21 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:16:21 user nova-compute[71269]:     </memballoon>
Apr 13 23:16:21 user nova-compute[71269]:   </devices>
Apr 13 23:16:21 user nova-compute[71269]: </domain>
Apr 13 23:16:21 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:23:cf:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG os_vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09cc0c17-bd, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09cc0c17-bd, col_values=(('external_ids', {'iface-id': '09cc0c17-bd49-4207-9de4-89178a1e681e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:cf:d9', 'vm-uuid': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:21 user nova-compute[71269]: INFO os_vif [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:23:cf:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:16:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:23 user nova-compute[71269]: WARNING nova.compute.manager [req-46717121-fd5d-4b05-af53-f9da8c4e5ac8 req-e4d05e8b-e55d-4923-a231-25ab2954b15d service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state resize_finish.
Apr 13 23:16:23 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427768.4305232, 7226cc11-4c2c-4a27-bb02-87ba1f749d33 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:16:23 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] VM Stopped (Lifecycle Event)
Apr 13 23:16:23 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e2335985-db1f-439a-9267-122b5422d682 None None] [instance: 7226cc11-4c2c-4a27-bb02-87ba1f749d33] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427785.1632507, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:16:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Resumed (Lifecycle Event)
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:25 user nova-compute[71269]: WARNING nova.compute.manager [req-64552b87-c8f5-453f-ac7c-36e851b74642 req-a0a9f58e-19a3-495a-99f8-ff37db447c8c service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state resize_finish.
Apr 13 23:16:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance running successfully.
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Failed to set time: agent not configured {{(pid=71269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-f7a68b82-7b19-4796-b399-9a528e1d670c tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] finish_migration finished successfully. {{(pid=71269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:16:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427785.163364, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:16:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Started (Lifecycle Event)
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:16:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:16:25 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 23:16:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Ignoring supplied device name: /dev/vdb
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:30 user nova-compute[71269]: INFO nova.compute.manager [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Attaching volume 9758d34b-f5c6-4696-92ad-30da450361d3 to /dev/vdb
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.utils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa897302-085c-4131-9a93-556ddb3c1dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b865ab7b-2eee-4daf-8531-c877b5c4e4c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bcfa73-46e6-45e1-8da7-06524c27f705]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5dbdf-a472-4fc7-b155-ecefcc47af9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:16:30 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:16:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b0cd3-1641-4d3f-bdc8-4a1934037a35]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG os_brick.utils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:30 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Updating existing volume attachment record: ceaa8dcb-7d39-4ec5-a7ca-e08fc8ac1543 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:16:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKuHACXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:35 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:35 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[475540bd-a8cf-452b-bd55-0613032170a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:16:35 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee9f63-643f-4bd6-908a-e22bf56e04c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3] added
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d1daa-8703-49f9-a085-3ceae7433062]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec934e-654f-4a80-ae17-c78ebc9ee43c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKuHACXp {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKuHACXp" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64cca9-0308-437c-b5b0-1e95768c4b5c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKuHACXp'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb45b4-28f1-4ae5-9dc9-0b55b93c51ff]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2eac9-aebf-49eb-9b2f-18e0e307461c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7f091-1dfa-4ab1-9623-867f2e77e0f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260]
Apr 13 23:16:35 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d82fdf-7f55-497c-8ef2-46fd32601c11]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[504333e9-6946-4f19-92af-fa94e16f50d8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)
Apr 13 23:16:35 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d899b0-8b68-49cf-a33b-de361e2a8d86]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:35 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKuHACXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26635303166366434', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635303166366434', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG nova.objects.instance [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:16:36 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:36 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:16:36 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:36 user nova-compute[71269]:   <serial>9758d34b-f5c6-4696-92ad-30da450361d3</serial>
Apr 13 23:16:36 user nova-compute[71269]: </disk>
Apr 13 23:16:36 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:16:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:16:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] No VIF found with MAC fa:16:3e:cd:d0:56, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:16:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-86724583-04ec-4f32-9f79-b585ab8d8f6f tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.829s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:51 user nova-compute[71269]: INFO nova.compute.manager [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Detaching volume 9758d34b-f5c6-4696-92ad-30da450361d3
Apr 13 23:16:51 user nova-compute[71269]: INFO nova.virt.block_device [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Attempting to driver detach volume 9758d34b-f5c6-4696-92ad-30da450361d3 from mountpoint /dev/vdb
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Attempting to detach device vdb from instance 08e157a4-85f9-466f-b02c-fd0fc629b302 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:16:51 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:51 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:16:51 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:51 user nova-compute[71269]:   <serial>9758d34b-f5c6-4696-92ad-30da450361d3</serial>
Apr 13 23:16:51 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:16:51 user nova-compute[71269]: </disk>
Apr 13 23:16:51 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:16:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully detached device vdb from instance 08e157a4-85f9-466f-b02c-fd0fc629b302 from the persistent domain config.
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08e157a4-85f9-466f-b02c-fd0fc629b302 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:16:51 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:16:51 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:16:51 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:16:51 user nova-compute[71269]:   <serial>9758d34b-f5c6-4696-92ad-30da450361d3</serial>
Apr 13 23:16:51 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:16:51 user nova-compute[71269]: </disk>
Apr 13 23:16:51 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427811.8866756, 08e157a4-85f9-466f-b02c-fd0fc629b302 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:16:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully detached device vdb from instance 08e157a4-85f9-466f-b02c-fd0fc629b302 from the live domain config.
Apr 13 23:16:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKuHACXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfaf06-2c1a-4133-abbb-ebef5be14552]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:16:51 user nova-compute[71269]: No targets found.
Apr 13 23:16:51 user nova-compute[71269]: iSNS:
Apr 13 23:16:51 user nova-compute[71269]: No targets found.
Apr 13 23:16:51 user nova-compute[71269]: STATIC:
Apr 13 23:16:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:16:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3
Apr 13 23:16:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:51 user nova-compute[71269]: FIRMWARE:
Apr 13 23:16:51 user nova-compute[71269]: No targets found.
Apr 13 23:16:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:16:51 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:16:51 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10151f3e-603a-4e87-bd09-7dbeae7a6e55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac846ffb-36b9-4be3-ad7e-5491d25af3cf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:51 user nova-compute[71269]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)
Apr 13 23:16:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:51 user nova-compute[71269]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 (non-flash)
Apr 13 23:16:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c012ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[679aacf2-cf12-461b-a415-96c1f917f876]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b87ff4b-4563-4da5-877f-936843387ab0]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab4545c-e94e-422b-b8f3-083bdd607d58]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6885667-70ff-4ffa-a5b3-ec9179bc8d37]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7278226-e48c-4a71-8189-85ba6a2a7a49]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d61ae-2f21-4a51-9fd8-ef124a053546]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260]
Apr 13 23:16:52 user nova-compute[71269]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3, portal: 172.16.0.220,3260] successful.
Apr 13 23:16:52 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7a013-a25d-4ad1-8a04-e63b6dd5dd4d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== disconnect_volume: return (311ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:16:52 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'flavor' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e1e26014-a54f-4340-9b72-e9606c88961c tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.497s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:53 user nova-compute[71269]: INFO nova.compute.manager [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Terminating instance
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-d683f0e9-1848-4dc5-9ba6-f36c3a845b38 req-a7703e28-eed5-4776-a93a-c11901272b89 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Instance destroyed successfully.
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lazy-loading 'resources' on Instance uuid 08e157a4-85f9-466f-b02c-fd0fc629b302 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1764780472',display_name='tempest-VolumesSnapshotTestJSON-instance-1764780472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1764780472',id=40,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cebfec442634e41b173904833269463',ramdisk_id='',reservation_id='r-80tdkiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1344748200',owner_user_name='tempest-VolumesSnapshotTestJSON-1344748200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:14:47Z,user_data=None,user_id='5a1420e7febd479e8f23ad9784950f65',uuid=08e157a4-85f9-466f-b02c-fd0fc629b302,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converting VIF {"id": "5d213358-47f2-4420-be2b-8b4e69421009", "address": "fa:16:3e:cd:d0:56", "network": {"id": "005b22e6-73d8-42f9-bd5c-8d4aad956bfe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829302760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5cebfec442634e41b173904833269463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d213358-47", "ovs_interfaceid": "5d213358-47f2-4420-be2b-8b4e69421009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_vif [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d213358-47, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:16:53 user nova-compute[71269]: INFO os_vif [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=5d213358-47f2-4420-be2b-8b4e69421009,network=Network(005b22e6-73d8-42f9-bd5c-8d4aad956bfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d213358-47')
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKuHACXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:16:53 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b538c68-fba1-45e8-97a4-7ce9d21fc1da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:16:53 user nova-compute[71269]: No targets found.
Apr 13 23:16:53 user nova-compute[71269]: iSNS:
Apr 13 23:16:53 user nova-compute[71269]: No targets found.
Apr 13 23:16:53 user nova-compute[71269]: STATIC:
Apr 13 23:16:53 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:16:53 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:16:53 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:16:53 user nova-compute[71269]: FIRMWARE:
Apr 13 23:16:53 user nova-compute[71269]: No targets found.
Apr 13 23:16:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:16:53 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:16:53 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9758d34b-f5c6-4696-92ad-30da450361d3', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed4c7b-7fb5-482a-adf3-f30b7545c6bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad094e64-8e75-416d-9c27-fea2fbc947fb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:16:53 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb47b370>, {}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Disconnecting from: [] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] <== disconnect_volume: return (75ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:16:53 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Deleting instance files /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302_del
Apr 13 23:16:53 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Deletion of /opt/stack/data/nova/instances/08e157a4-85f9-466f-b02c-fd0fc629b302_del complete
Apr 13 23:16:53 user nova-compute[71269]: INFO nova.compute.manager [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 23:16:53 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:16:53 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:16:54 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Took 0.52 seconds to deallocate network for instance.
Apr 13 23:16:54 user nova-compute[71269]: DEBUG nova.compute.manager [req-f9d23eb8-16b4-4915-9c53-2053cc27ede7 req-fe3f30ed-8042-4809-9768-68827d3772fe service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-deleted-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:54 user nova-compute[71269]: WARNING nova.volume.cinder [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Attachment ceaa8dcb-7d39-4ec5-a7ca-e08fc8ac1543 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ceaa8dcb-7d39-4ec5-a7ca-e08fc8ac1543. (HTTP 404) (Request-ID: req-4e137b9d-0c92-4bf8-ac9a-96c259c03a1f)
Apr 13 23:16:54 user nova-compute[71269]: INFO nova.compute.manager [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 23:16:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:16:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:54 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Deleted allocations for instance 08e157a4-85f9-466f-b02c-fd0fc629b302
Apr 13 23:16:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c0798932-0005-4712-9a84-8d0ac81dfc8b tempest-VolumesSnapshotTestJSON-1344748200 tempest-VolumesSnapshotTestJSON-1344748200-project-member] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:55 user nova-compute[71269]: WARNING nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state deleted and task_state None.
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:55 user nova-compute[71269]: WARNING nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state deleted and task_state None.
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:55 user nova-compute[71269]: WARNING nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state deleted and task_state None.
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:55 user nova-compute[71269]: WARNING nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-unplugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state deleted and task_state None.
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Acquiring lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] Lock "08e157a4-85f9-466f-b02c-fd0fc629b302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:16:55 user nova-compute[71269]: DEBUG nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] No waiting events found dispatching network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:16:55 user nova-compute[71269]: WARNING nova.compute.manager [req-273feb6f-a172-42af-8d8a-80c2ef7a87cb req-741b670a-94f4-4e5d-afa1-9ca3aaeada78 service nova] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Received unexpected event network-vif-plugged-5d213358-47f2-4420-be2b-8b4e69421009 for instance with vm_state deleted and task_state None.
Apr 13 23:16:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:17:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:04 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:06 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:17:06 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=26.282711029052734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Applying migration context for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d as it has an incoming, in-progress migration 8aa0c956-873f-4f54-ad88-fb8d5fe4ac0c. Migration status is finished {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 23:17:06 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating resource usage from migration 8aa0c956-873f-4f54-ad88-fb8d5fe4ac0c
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 9de39303-da44-47ae-adef-ff80f0b792a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Migration 8aa0c956-873f-4f54-ad88-fb8d5fe4ac0c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:17:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:08 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427813.7776887, 08e157a4-85f9-466f-b02c-fd0fc629b302 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:17:08 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] VM Stopped (Lifecycle Event)
Apr 13 23:17:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-6ffcb7ac-cdc2-4341-b057-57f9153a0196 None None] [instance: 08e157a4-85f9-466f-b02c-fd0fc629b302] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:17:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:17:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:17:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:17:10 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:17:12 user nova-compute[71269]: INFO nova.compute.claims [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Claim successful on node user
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:17:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.policy [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:17:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Creating image(s)
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk 1073741824" returned: 0 in 0.069s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Successfully created port: b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Cannot resize image /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'migration_context' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Ensure instance console log exists: /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Successfully updated port: b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing instance network info cache due to event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance network_info: |[{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.neutron [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start _get_guest_xml network_info=[{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:17:14 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:17:14 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRHhnAKdZFUW2qGL3xJyfalvtnzUb12fQWEKaj1zVCyg5qFeLmoWDgWt5B/CDTEZ5VNMSCnig9fSEEvVhciP/p+fUw6A9lTrWimhc/xwqS7liP8+sW9m/AzIzM0EZ7OOg==',key_name='tempest-keypair-106580173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:17:14 user nova-compute[71269]:   <uuid>7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</uuid>
Apr 13 23:17:14 user nova-compute[71269]:   <name>instance-0000002a</name>
Apr 13 23:17:14 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:17:14 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:17:14 user nova-compute[71269]:   <metadata>
Apr 13 23:17:14 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:17:14 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-567976838</nova:name>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:17:14</nova:creationTime>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:17:14 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:17:14 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:owner>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:user uuid="e66f624501c3404bb1eb9412a8a6c951">tempest-AttachVolumeShelveTestJSON-953327095-project-member</nova:user>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:project uuid="b9ad0d0e72ad43cca506267d62269910">tempest-AttachVolumeShelveTestJSON-953327095</nova:project>
Apr 13 23:17:14 user nova-compute[71269]:       </nova:owner>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:17:14 user nova-compute[71269]:       <nova:ports>
Apr 13 23:17:14 user nova-compute[71269]:         <nova:port uuid="b3a3698d-6a99-43ff-8298-a59026248b01">
Apr 13 23:17:14 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 23:17:14 user nova-compute[71269]:         </nova:port>
Apr 13 23:17:14 user nova-compute[71269]:       </nova:ports>
Apr 13 23:17:14 user nova-compute[71269]:     </nova:instance>
Apr 13 23:17:14 user nova-compute[71269]:   </metadata>
Apr 13 23:17:14 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:17:14 user nova-compute[71269]:     <system>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="serial">7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</entry>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="uuid">7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</entry>
Apr 13 23:17:14 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:17:14 user nova-compute[71269]:     </system>
Apr 13 23:17:14 user nova-compute[71269]:   </sysinfo>
Apr 13 23:17:14 user nova-compute[71269]:   <os>
Apr 13 23:17:14 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:17:14 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:17:14 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:17:14 user nova-compute[71269]:   </os>
Apr 13 23:17:14 user nova-compute[71269]:   <features>
Apr 13 23:17:14 user nova-compute[71269]:     <acpi/>
Apr 13 23:17:14 user nova-compute[71269]:     <apic/>
Apr 13 23:17:14 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:17:14 user nova-compute[71269]:   </features>
Apr 13 23:17:14 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:17:14 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:17:14 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:17:14 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:17:14 user nova-compute[71269]:   </clock>
Apr 13 23:17:14 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:17:14 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:17:14 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:17:14 user nova-compute[71269]:   </cpu>
Apr 13 23:17:14 user nova-compute[71269]:   <devices>
Apr 13 23:17:14 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:17:14 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:17:14 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk"/>
Apr 13 23:17:14 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:17:14 user nova-compute[71269]:     </disk>
Apr 13 23:17:14 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:17:14 user nova-compute[71269]:       <mac address="fa:16:3e:45:1b:fe"/>
Apr 13 23:17:14 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:17:14 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:17:14 user nova-compute[71269]:       <target dev="tapb3a3698d-6a"/>
Apr 13 23:17:14 user nova-compute[71269]:     </interface>
Apr 13 23:17:14 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:17:14 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/console.log" append="off"/>
Apr 13 23:17:14 user nova-compute[71269]:     </serial>
Apr 13 23:17:14 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:17:14 user nova-compute[71269]:     <video>
Apr 13 23:17:14 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:17:14 user nova-compute[71269]:     </video>
Apr 13 23:17:14 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:17:14 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:17:14 user nova-compute[71269]:     </rng>
Apr 13 23:17:14 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:17:14 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:17:14 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:17:14 user nova-compute[71269]:     </memballoon>
Apr 13 23:17:14 user nova-compute[71269]:   </devices>
Apr 13 23:17:14 user nova-compute[71269]: </domain>
Apr 13 23:17:14 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRHhnAKdZFUW2qGL3xJyfalvtnzUb12fQWEKaj1zVCyg5qFeLmoWDgWt5B/CDTEZ5VNMSCnig9fSEEvVhciP/p+fUw6A9lTrWimhc/xwqS7liP8+sW9m/AzIzM0EZ7OOg==',key_name='tempest-keypair-106580173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG os_vif [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3a3698d-6a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3a3698d-6a, col_values=(('external_ids', {'iface-id': 'b3a3698d-6a99-43ff-8298-a59026248b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:1b:fe', 'vm-uuid': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:14 user nova-compute[71269]: INFO os_vif [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a')
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:17:14 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No VIF found with MAC fa:16:3e:45:1b:fe, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:17:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updated VIF entry in instance network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:17:15 user nova-compute[71269]: DEBUG nova.network.neutron [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a99eb5c0-1193-47b7-b764-615d39a25ee2 req-ea5f495c-9d93-4a3b-879f-a8d409b3ab6a service nova] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG nova.compute.manager [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:17:16 user nova-compute[71269]: WARNING nova.compute.manager [req-2afb6155-71e7-4209-b5ac-a36d597e4634 req-b29d7cd0-643e-4773-b8ee-3624a109eb8e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state building and task_state spawning.
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427838.331069, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Resumed (Lifecycle Event)
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance spawned successfully.
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427838.3351011, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Started (Lifecycle Event)
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:17:18 user nova-compute[71269]: WARNING nova.compute.manager [req-c550c57d-fd1b-4805-9e82-921becf259be req-3d8125cf-a5d2-4631-8d35-128d9250f0a6 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state building and task_state spawning.
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:17:18 user nova-compute[71269]: INFO nova.compute.manager [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Took 6.33 seconds to build instance.
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4602f4b9-e8da-40fa-ae98-a064fd1fb03b tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.434s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.compute.manager [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing instance network info cache due to event network-changed-16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Acquiring lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Acquired lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:17:18 user nova-compute[71269]: DEBUG nova.network.neutron [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Refreshing network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updated VIF entry in instance network info cache for port 16379ba5-9e41-4846-9ac8-8b5e86b776c0. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [{"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6052dece-9840-4765-a905-9ded422c2402 req-f117e424-8aac-47cc-aea1-b70185efa89f service nova] Releasing lock "refresh_cache-9de39303-da44-47ae-adef-ff80f0b792a7" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing instance network info cache due to event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updated VIF entry in instance network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e82f7d2-2503-4a87-96d2-5f23dd0e8561 req-291cffeb-2538-49cc-b568-96b883380a51 service nova] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:17:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:21 user nova-compute[71269]: INFO nova.compute.manager [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Attaching volume b781e478-ccad-4879-a98b-59c42a5c8b70 to /dev/vdb
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.utils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172561b-4713-464c-8ee7-55daf0805e4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c0de3-a5bd-4bc5-af11-0aac2921a600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17168b60-30eb-4ca9-9783-5258ea684c80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9b61f9-eb63-4b37-8c0c-4b136d712d73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:17:21 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:17:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2ebef-e63d-4ee5-af33-0f0663969e1c]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG os_brick.utils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:17:21 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating existing volume attachment record: 22d20ed7-f111-4c66-b986-7a84678da053 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:22 user nova-compute[71269]: INFO nova.compute.manager [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Terminating instance
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.compute.manager [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-unplugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] No waiting events found dispatching network-vif-unplugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-e3d2e34a-2626-4645-a963-ad5db7b9428e req-45d6f98e-bcc8-4e13-8149-61c34afb8ae0 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-unplugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Instance destroyed successfully.
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lazy-loading 'resources' on Instance uuid 9de39303-da44-47ae-adef-ff80f0b792a7 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1645185487',display_name='tempest-SnapshotDataIntegrityTests-server-1645185487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1645185487',id=37,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbB6sa0qGoo1uWEnwUaJj9s1UuIKgrOwtILphdBtTQizKy9xpM5DtQrXIJG+9yp8i8o8V+z8fU91AFXEqYnHagF++bPRquFDt0mPaYitTF7YiPTAyUmr8TXVZldj1JB0Q==',key_name='tempest-SnapshotDataIntegrityTests-1668706765',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59f4ef55afe342ebb945ad336e01582a',ramdisk_id='',reservation_id='r-ql7l2eat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1787800466',owner_user_name='tempest-SnapshotDataIntegrityTests-1787800466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:10:56Z,user_data=None,user_id='d2a6385ae82042ad9682f7728b8263da',uuid=9de39303-da44-47ae-adef-ff80f0b792a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converting VIF {"id": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "address": "fa:16:3e:80:4c:a0", "network": {"id": "58238917-04e7-4754-b79c-63038e274ac3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-720213438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59f4ef55afe342ebb945ad336e01582a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16379ba5-9e", "ovs_interfaceid": "16379ba5-9e41-4846-9ac8-8b5e86b776c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG os_vif [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16379ba5-9e, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:17:22 user nova-compute[71269]: INFO os_vif [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4c:a0,bridge_name='br-int',has_traffic_filtering=True,id=16379ba5-9e41-4846-9ac8-8b5e86b776c0,network=Network(58238917-04e7-4754-b79c-63038e274ac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16379ba5-9e')
Apr 13 23:17:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Deleting instance files /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7_del
Apr 13 23:17:22 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Deletion of /opt/stack/data/nova/instances/9de39303-da44-47ae-adef-ff80f0b792a7_del complete
Apr 13 23:17:23 user nova-compute[71269]: INFO nova.compute.manager [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 23:17:23 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:23 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Took 0.47 seconds to deallocate network for instance.
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-deleted-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:23 user nova-compute[71269]: INFO nova.compute.manager [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Neutron deleted interface 16379ba5-9e41-4846-9ac8-8b5e86b776c0; detaching it from the instance and deleting it from the info cache
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-056ba109-fa91-4d85-a516-190f509844ee req-790b0080-36c7-4e79-a555-2862d86e7ef7 service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Detach interface failed, port_id=16379ba5-9e41-4846-9ac8-8b5e86b776c0, reason: Instance 9de39303-da44-47ae-adef-ff80f0b792a7 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:23 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:24 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Deleted allocations for instance 9de39303-da44-47ae-adef-ff80f0b792a7
Apr 13 23:17:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13787be4-4901-4d4c-818e-c30b84f66a7c tempest-SnapshotDataIntegrityTests-1787800466 tempest-SnapshotDataIntegrityTests-1787800466-project-member] Lock "9de39303-da44-47ae-adef-ff80f0b792a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Acquiring lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] Lock "9de39303-da44-47ae-adef-ff80f0b792a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] No waiting events found dispatching network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:17:24 user nova-compute[71269]: WARNING nova.compute.manager [req-346ce5b0-dd07-4fd4-908c-6e6d742c35f4 req-8fba519b-e1fc-42bb-ac29-58d97f91748d service nova] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Received unexpected event network-vif-plugged-16379ba5-9e41-4846-9ac8-8b5e86b776c0 for instance with vm_state deleted and task_state None.
Apr 13 23:17:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIYOpqTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:17:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:17:25 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:17:25 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e8455-ef5f-4592-a4d6-1d5d9d1e79ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:17:25 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f86f3c2-0f65-4fb5-9968-c30f142735e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70] added
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4dda24-ece6-4308-9677-d3c951c8d0e6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a494799-179b-46ec-a988-876e7f66c7e7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIYOpqTC {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIYOpqTC" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb38f3d-a5ba-4c6c-867e-9c0740200741]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DIYOpqTC'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.072s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d513db2-8e3a-47ef-aaf0-46f8c5473eea]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9491698-3b1c-42d6-b60a-86f1d86121e0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511215b-1791-4c74-ab61-de1c1498d7f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260]
Apr 13 23:17:25 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260] successful.
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8776dbb3-4301-41ba-85d6-8e610001b6d0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f120e84-6cad-4ff0-bbc3-22af5d02f36d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)
Apr 13 23:17:25 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ffad9d-d0ac-448b-8f31-530fe48e932f]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:17:25 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIYOpqTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:17:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:17:26 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23866353862346636', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:17:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866353862346636', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:17:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:17:27 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:17:27 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:17:27 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:17:27 user nova-compute[71269]:   <serial>b781e478-ccad-4879-a98b-59c42a5c8b70</serial>
Apr 13 23:17:27 user nova-compute[71269]: </disk>
Apr 13 23:17:27 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No VIF found with MAC fa:16:3e:49:ba:a6, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-57f416fa-31db-4b9b-93e4-17085be42c61 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.608s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:17:30 user nova-compute[71269]: INFO nova.compute.manager [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Detaching volume b781e478-ccad-4879-a98b-59c42a5c8b70
Apr 13 23:17:30 user nova-compute[71269]: INFO nova.virt.block_device [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Attempting to driver detach volume b781e478-ccad-4879-a98b-59c42a5c8b70 from mountpoint /dev/vdb
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Attempting to detach device vdb from instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:17:30 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:17:30 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:17:30 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:17:30 user nova-compute[71269]:   <serial>b781e478-ccad-4879-a98b-59c42a5c8b70</serial>
Apr 13 23:17:30 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:17:30 user nova-compute[71269]: </disk>
Apr 13 23:17:30 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:17:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully detached device vdb from instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 from the persistent domain config.
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:17:30 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:17:30 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:17:30 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:17:30 user nova-compute[71269]:   <serial>b781e478-ccad-4879-a98b-59c42a5c8b70</serial>
Apr 13 23:17:30 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:17:30 user nova-compute[71269]: </disk>
Apr 13 23:17:30 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681427850.635582, f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:17:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully detached device vdb from instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 from the live domain config.
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIYOpqTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:17:30 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf2ec0b-e3b3-46ac-abf5-8c293e0517f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:17:30 user nova-compute[71269]: No targets found.
Apr 13 23:17:30 user nova-compute[71269]: iSNS:
Apr 13 23:17:30 user nova-compute[71269]: No targets found.
Apr 13 23:17:30 user nova-compute[71269]: STATIC:
Apr 13 23:17:30 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:17:30 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:17:30 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:17:30 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70
Apr 13 23:17:30 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:17:30 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:17:30 user nova-compute[71269]: FIRMWARE:
Apr 13 23:17:30 user nova-compute[71269]: No targets found.
Apr 13 23:17:30 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:17:30 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:17:30 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ce166-3630-42dd-bb8e-779c384a6098]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40292d2e-6b1c-4071-ba96-f887fa119a8b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:30 user nova-compute[71269]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)
Apr 13 23:17:30 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:17:30 user nova-compute[71269]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 (non-flash)
Apr 13 23:17:30 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3cb31d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bace7e-5a15-4bd1-97f0-c33d79f3f5f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[536cbd4d-c917-4133-9190-858b725eb925]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d614f517-46b9-45b8-aeff-9be1433bbe45]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5dec91-fe16-4fee-b868-f97595ee834f]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a217869d-0ee1-4b7d-b4ed-4cb818ee1f2f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e83738-29cb-4c94-87e7-36132e936469]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260]
Apr 13 23:17:30 user nova-compute[71269]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70, portal: 172.16.0.220,3260] successful.
Apr 13 23:17:30 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b781e478-ccad-4879-a98b-59c42a5c8b70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf73235-c603-4f0f-9af8-fd74e566dbcb]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== disconnect_volume: return (322ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:17:30 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:17:31 user nova-compute[71269]: DEBUG nova.objects.instance [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:17:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-24f74bbc-a580-4491-9d10-f756f0bed575 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.864s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:17:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:37 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427842.9143066, 9de39303-da44-47ae-adef-ff80f0b792a7 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:17:37 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] VM Stopped (Lifecycle Event)
Apr 13 23:17:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f014d8da-12c3-4dec-a8a7-1d3842933441 None None] [instance: 9de39303-da44-47ae-adef-ff80f0b792a7] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:17:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:17:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Port 09cc0c17-bd49-4207-9de4-89178a1e681e binding to destination host user is already ACTIVE {{(pid=71269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Creating tmpfile /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/tmpzayu57c0 to verify with other compute node that the instance is on the same shared storage. {{(pid=71269) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.compute.manager [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:01 user nova-compute[71269]: WARNING nova.compute.manager [req-2f492b13-2d91-4af8-a6ca-24bc84ba87ec req-36215c49-7d23-4fe0-9978-97eb3c79e4b8 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state resized and task_state resize_reverting.
Apr 13 23:18:01 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance destroyed successfully.
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09cc0c17-bd, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:18:01 user nova-compute[71269]: INFO os_vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:18:01 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e5caf-3cbe-4c2f-9f6e-f85ca6207905]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:18:01 user nova-compute[71269]: No targets found.
Apr 13 23:18:01 user nova-compute[71269]: iSNS:
Apr 13 23:18:01 user nova-compute[71269]: No targets found.
Apr 13 23:18:01 user nova-compute[71269]: STATIC:
Apr 13 23:18:01 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:18:01 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:18:01 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:18:01 user nova-compute[71269]: FIRMWARE:
Apr 13 23:18:01 user nova-compute[71269]: No targets found.
Apr 13 23:18:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:18:01 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:18:01 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ae6e6-20be-4892-a227-844b5765ba5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[845194bb-ba41-43db-8933-a270cc87db32]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c689fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60781c2-2164-4c80-92bf-dc6d7a5ae3aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbe0497-7459-4dbe-be6d-bf2cbf4731c2]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da205d1-3572-4816-8022-8084936ec8c0]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71aedcc-2315-4f48-98cd-385957463a10]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf75eb3-9e18-4901-8fbb-42620ed661d7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11858b-c7d8-48fb-81be-b34d55d674fd]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:18:01 user nova-compute[71269]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:18:01 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3889278b-6f75-476e-84ba-bca7cc37aa0c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (291ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:18:01 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:18:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'migration_context' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:03 user nova-compute[71269]: WARNING nova.compute.manager [req-d9b94e4a-f8d1-4dcd-a5d7-c24da2145b76 req-70d9f5ca-1750-4d75-8d43-eb27a05f9763 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state resized and task_state resize_reverting.
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.354s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:03 user nova-compute[71269]: INFO nova.compute.manager [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Swapping old allocation on dict_keys(['e216f943-de42-42dc-843a-799496cf2730']) held by migration 8aa0c956-873f-4f54-ad88-fb8d5fe4ac0c for instance
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Overwriting current allocation {'allocations': {'e216f943-de42-42dc-843a-799496cf2730': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 46}}, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'user_id': '59b2c11a23384f678a086de89139497d', 'consumer_generation': 1} on consumer d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:18:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.utils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b8b2c-7307-4d4a-9282-322005297b01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7e59e-e52b-4fa6-890c-ec826868ee2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b5e87-3d06-485d-b3fe-a3c7742a9a26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3114a-a668-41e0-a6a0-045d8261b6e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:18:04 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:18:04 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5153ed-002f-4f0e-96fd-9c13d7eb7a4d]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG os_brick.utils [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:18:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:05 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:07 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=26.271148681640625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:18:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Starting finish_revert_migration {{(pid=71269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start _get_guest_xml network_info=[{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '2f3e8acd-0040-4c51-aaa7-3b03798f5166', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d', 'attached_at': '2023-04-13T23:18:09.000000', 'detached_at': '', 'volume_id': 'ef4e4a35-555c-4395-acaf-17e3d7446b18', 'serial': 'ef4e4a35-555c-4395-acaf-17e3d7446b18'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:18:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:18:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:18:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:18:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:18:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:18:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:18:08 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:18:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fa957-d93d-4abd-a331-90e0a4552956]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:18:09 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a6342-fc41-417d-a5c0-f540c6db5da0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18] added
Apr 13 23:18:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33db48-8949-43bc-84ce-6894b292d130]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608b057-8bc8-494d-8919-7767ab7c209d]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzpRBCtF" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88377d-f4a2-467f-b3af-7342e28ca518]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzpRBCtF'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d749498-b103-4093-b341-06db8a88afa3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[14097f2a-0d2e-4b66-b4d0-71013ee691db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:18:09 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:18:09 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:18:09 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 23:18:09 user nova-compute[71269]: 
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ac19c-e7a0-42dc-ab37-fcda9bbde31f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:18:09 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:18:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b572fc-b6be-4115-86f8-8e4e9192a367]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4d77b-687d-4320-ad59-4cc2a4159bb5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:09 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f001997-747e-41fd-a6fd-d3e52a7ce41b]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663163623461', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:18:10 user nova-compute[71269]:   <uuid>d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</uuid>
Apr 13 23:18:10 user nova-compute[71269]:   <name>instance-00000021</name>
Apr 13 23:18:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:18:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:18:10 user nova-compute[71269]:   <metadata>
Apr 13 23:18:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:18:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-19843969</nova:name>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:18:08</nova:creationTime>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:18:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:18:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:owner>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:18:10 user nova-compute[71269]:       </nova:owner>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:18:10 user nova-compute[71269]:       <nova:ports>
Apr 13 23:18:10 user nova-compute[71269]:         <nova:port uuid="09cc0c17-bd49-4207-9de4-89178a1e681e">
Apr 13 23:18:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:18:10 user nova-compute[71269]:         </nova:port>
Apr 13 23:18:10 user nova-compute[71269]:       </nova:ports>
Apr 13 23:18:10 user nova-compute[71269]:     </nova:instance>
Apr 13 23:18:10 user nova-compute[71269]:   </metadata>
Apr 13 23:18:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:18:10 user nova-compute[71269]:     <system>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="serial">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="uuid">d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d</entry>
Apr 13 23:18:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:18:10 user nova-compute[71269]:     </system>
Apr 13 23:18:10 user nova-compute[71269]:   </sysinfo>
Apr 13 23:18:10 user nova-compute[71269]:   <os>
Apr 13 23:18:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:18:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:18:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:18:10 user nova-compute[71269]:   </os>
Apr 13 23:18:10 user nova-compute[71269]:   <features>
Apr 13 23:18:10 user nova-compute[71269]:     <acpi/>
Apr 13 23:18:10 user nova-compute[71269]:     <apic/>
Apr 13 23:18:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:18:10 user nova-compute[71269]:   </features>
Apr 13 23:18:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:18:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:18:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:18:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:18:10 user nova-compute[71269]:   </clock>
Apr 13 23:18:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:18:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:18:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:18:10 user nova-compute[71269]:   </cpu>
Apr 13 23:18:10 user nova-compute[71269]:   <devices>
Apr 13 23:18:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:18:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:18:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk"/>
Apr 13 23:18:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:18:10 user nova-compute[71269]:     </disk>
Apr 13 23:18:10 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:18:10 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:18:10 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:18:10 user nova-compute[71269]:       <target dev="vdb" bus="virtio"/>
Apr 13 23:18:10 user nova-compute[71269]:       <serial>ef4e4a35-555c-4395-acaf-17e3d7446b18</serial>
Apr 13 23:18:10 user nova-compute[71269]:     </disk>
Apr 13 23:18:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:18:10 user nova-compute[71269]:       <mac address="fa:16:3e:23:cf:d9"/>
Apr 13 23:18:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:18:10 user nova-compute[71269]:       <target dev="tap09cc0c17-bd"/>
Apr 13 23:18:10 user nova-compute[71269]:     </interface>
Apr 13 23:18:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:18:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/console.log" append="off"/>
Apr 13 23:18:10 user nova-compute[71269]:     </serial>
Apr 13 23:18:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:18:10 user nova-compute[71269]:     <video>
Apr 13 23:18:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:10 user nova-compute[71269]:     </video>
Apr 13 23:18:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:18:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:18:10 user nova-compute[71269]:     </rng>
Apr 13 23:18:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:18:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:18:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:18:10 user nova-compute[71269]:     </memballoon>
Apr 13 23:18:10 user nova-compute[71269]:   </devices>
Apr 13 23:18:10 user nova-compute[71269]: </domain>
Apr 13 23:18:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG os_vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09cc0c17-bd, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09cc0c17-bd, col_values=(('external_ids', {'iface-id': '09cc0c17-bd49-4207-9de4-89178a1e681e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:cf:d9', 'vm-uuid': 'd3b4e1d5-1dce-4a64-8e09-68fadfe79a0d'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:10 user nova-compute[71269]: INFO os_vif [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:11 user nova-compute[71269]: WARNING nova.compute.manager [req-5dd4afa5-31d3-4963-b9b9-7c1ca8ab5337 req-0d154975-b76b-4db0-9f75-a8957ea9cc22 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state resized and task_state resize_reverting.
Apr 13 23:18:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427893.8945296, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Resumed (Lifecycle Event)
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:18:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance running successfully.
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] finish_revert_migration finished successfully. {{(pid=71269) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427893.895797, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Started (Lifecycle Event)
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:14 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 23:18:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:14 user nova-compute[71269]: WARNING nova.compute.manager [req-2d559278-a431-434f-99c8-a5ae8eacb7fe req-083a073b-ad0e-4be9-b237-469206da5530 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state resized and task_state resize_reverting.
Apr 13 23:18:14 user nova-compute[71269]: INFO nova.compute.manager [None req-c836bec3-abe1-45ca-b327-b138b535d580 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance to original state: 'active'
Apr 13 23:18:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:24 user nova-compute[71269]: DEBUG nova.compute.manager [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:24 user nova-compute[71269]: INFO nova.compute.manager [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] instance snapshotting
Apr 13 23:18:24 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Beginning live snapshot process
Apr 13 23:18:24 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json -f qcow2 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d.delta 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d.delta 1073741824" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:25 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 23:18:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 23:18:26 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] COPY block job progress, current cursor: 6356992 final cursor: 43843584 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 23:18:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71269) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 23:18:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 23:18:27 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:18:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d.delta /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d.delta /opt/stack/data/nova/instances/snapshots/tmpfw1oa361/cf69652a60ad4411ba44b28b1cd88e7d" returned: 0 in 0.270s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Snapshot extracted, beginning image upload
Apr 13 23:18:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Snapshot image upload complete
Apr 13 23:18:29 user nova-compute[71269]: INFO nova.compute.manager [None req-fcd27df9-d697-4668-95d4-dc86e2029698 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Took 5.26 seconds to snapshot the instance on the hypervisor.
Apr 13 23:18:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:18:35 user nova-compute[71269]: INFO nova.compute.claims [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Claim successful on node user
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:18:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.policy [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17551363dd9f4e219ad7198b21509e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71645bbbfcc4e41994fe910043ca0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:18:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Creating image(s)
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "/opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "/opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "/opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "3300c2c96974d830ea27d8f78626831860c8a0d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "3300c2c96974d830ea27d8f78626831860c8a0d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Successfully created port: 5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG nova.virt.images [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 59b1def6-7e36-4983-81ea-7b924ee9a11c was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.part /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.part /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.converted" returned: 0 in 0.414s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "3300c2c96974d830ea27d8f78626831860c8a0d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.476s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Successfully updated port: 5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquired lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing instance network info cache due to event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Acquiring lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "3300c2c96974d830ea27d8f78626831860c8a0d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "3300c2c96974d830ea27d8f78626831860c8a0d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:18:38 user nova-compute[71269]: INFO nova.compute.claims [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Claim successful on node user
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3,backing_fmt=raw /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3,backing_fmt=raw /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk 1073741824" returned: 0 in 0.059s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "3300c2c96974d830ea27d8f78626831860c8a0d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'migration_context' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Ensure instance console log exists: /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Releasing lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Instance network_info: |[{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Acquired lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Start _get_guest_xml network_info=[{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='865465bf7ccb6b1d6163ceffd4b8c4bb',container_format='bare',created_at=2023-04-13T23:18:24Z,direct_url=<?>,disk_format='qcow2',id=59b1def6-7e36-4983-81ea-7b924ee9a11c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-128925242',owner='a71645bbbfcc4e41994fe910043ca0dd',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T23:18:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': '59b1def6-7e36-4983-81ea-7b924ee9a11c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:18:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='865465bf7ccb6b1d6163ceffd4b8c4bb',container_format='bare',created_at=2023-04-13T23:18:24Z,direct_url=<?>,disk_format='qcow2',id=59b1def6-7e36-4983-81ea-7b924ee9a11c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-128925242',owner='a71645bbbfcc4e41994fe910043ca0dd',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T23:18:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1940780057',display_name='tempest-TestStampPattern-server-1940780057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1940780057',id=43,image_ref='59b1def6-7e36-4983-81ea-7b924ee9a11c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-h76e5udg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f522c0be-7d51-421c-8d6c-d01ce6f6eb26',image_min_disk='1',image_min_ram='0',image_owner_id='a71645bbbfcc4e41994fe910043ca0dd',image_owner_project_name='tempest-TestStampPattern-1517924890',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1517924890-project-member',image_user_id='17551363dd9f4e219ad7198b21509e48',network_allocated='True',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:18:36Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=06283ac1-5795-455d-9f85-38880202537f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'pci_devices' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:18:38 user nova-compute[71269]:   <uuid>06283ac1-5795-455d-9f85-38880202537f</uuid>
Apr 13 23:18:38 user nova-compute[71269]:   <name>instance-0000002b</name>
Apr 13 23:18:38 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:18:38 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:18:38 user nova-compute[71269]:   <metadata>
Apr 13 23:18:38 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:18:38 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:name>tempest-TestStampPattern-server-1940780057</nova:name>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:18:38</nova:creationTime>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:18:38 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:18:38 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:owner>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:user uuid="17551363dd9f4e219ad7198b21509e48">tempest-TestStampPattern-1517924890-project-member</nova:user>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:project uuid="a71645bbbfcc4e41994fe910043ca0dd">tempest-TestStampPattern-1517924890</nova:project>
Apr 13 23:18:38 user nova-compute[71269]:       </nova:owner>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:root type="image" uuid="59b1def6-7e36-4983-81ea-7b924ee9a11c"/>
Apr 13 23:18:38 user nova-compute[71269]:       <nova:ports>
Apr 13 23:18:38 user nova-compute[71269]:         <nova:port uuid="5fc574ab-be44-4634-ba3f-ac0faf630044">
Apr 13 23:18:38 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 23:18:38 user nova-compute[71269]:         </nova:port>
Apr 13 23:18:38 user nova-compute[71269]:       </nova:ports>
Apr 13 23:18:38 user nova-compute[71269]:     </nova:instance>
Apr 13 23:18:38 user nova-compute[71269]:   </metadata>
Apr 13 23:18:38 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:18:38 user nova-compute[71269]:     <system>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="serial">06283ac1-5795-455d-9f85-38880202537f</entry>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="uuid">06283ac1-5795-455d-9f85-38880202537f</entry>
Apr 13 23:18:38 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:18:38 user nova-compute[71269]:     </system>
Apr 13 23:18:38 user nova-compute[71269]:   </sysinfo>
Apr 13 23:18:38 user nova-compute[71269]:   <os>
Apr 13 23:18:38 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:18:38 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:18:38 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:18:38 user nova-compute[71269]:   </os>
Apr 13 23:18:38 user nova-compute[71269]:   <features>
Apr 13 23:18:38 user nova-compute[71269]:     <acpi/>
Apr 13 23:18:38 user nova-compute[71269]:     <apic/>
Apr 13 23:18:38 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:18:38 user nova-compute[71269]:   </features>
Apr 13 23:18:38 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:18:38 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:18:38 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:18:38 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:18:38 user nova-compute[71269]:   </clock>
Apr 13 23:18:38 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:18:38 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:18:38 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:18:38 user nova-compute[71269]:   </cpu>
Apr 13 23:18:38 user nova-compute[71269]:   <devices>
Apr 13 23:18:38 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:18:38 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:18:38 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk"/>
Apr 13 23:18:38 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:18:38 user nova-compute[71269]:     </disk>
Apr 13 23:18:38 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:18:38 user nova-compute[71269]:       <mac address="fa:16:3e:d5:0f:76"/>
Apr 13 23:18:38 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:38 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:18:38 user nova-compute[71269]:       <target dev="tap5fc574ab-be"/>
Apr 13 23:18:38 user nova-compute[71269]:     </interface>
Apr 13 23:18:38 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:18:38 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/console.log" append="off"/>
Apr 13 23:18:38 user nova-compute[71269]:     </serial>
Apr 13 23:18:38 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:18:38 user nova-compute[71269]:     <video>
Apr 13 23:18:38 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:38 user nova-compute[71269]:     </video>
Apr 13 23:18:38 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:18:38 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:18:38 user nova-compute[71269]:     </rng>
Apr 13 23:18:38 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:18:38 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:18:38 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:18:38 user nova-compute[71269]:     </memballoon>
Apr 13 23:18:38 user nova-compute[71269]:   </devices>
Apr 13 23:18:38 user nova-compute[71269]: </domain>
Apr 13 23:18:38 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1940780057',display_name='tempest-TestStampPattern-server-1940780057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1940780057',id=43,image_ref='59b1def6-7e36-4983-81ea-7b924ee9a11c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-h76e5udg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f522c0be-7d51-421c-8d6c-d01ce6f6eb26',image_min_disk='1',image_min_ram='0',image_owner_id='a71645bbbfcc4e41994fe910043ca0dd',image_owner_project_name='tempest-TestStampPattern-1517924890',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1517924890-project-member',image_user_id='17551363dd9f4e219ad7198b21509e48',network_allocated='True',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:18:36Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=06283ac1-5795-455d-9f85-38880202537f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG os_vif [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fc574ab-be, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fc574ab-be, col_values=(('external_ids', {'iface-id': '5fc574ab-be44-4634-ba3f-ac0faf630044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:0f:76', 'vm-uuid': '06283ac1-5795-455d-9f85-38880202537f'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:38 user nova-compute[71269]: INFO os_vif [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be')
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No VIF found with MAC fa:16:3e:d5:0f:76, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:18:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:18:38 user nova-compute[71269]: INFO nova.virt.block_device [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Booting with volume b88ed41a-5418-4d62-a2fa-2a20ebb28d61 at /dev/vda
Apr 13 23:18:38 user nova-compute[71269]: DEBUG os_brick.utils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3740a1ba-b05e-454a-a34d-660fe3cd3ccf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG nova.policy [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '271839d0073b49689368301d420c588a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405da8dd69654b3fb74203d0b7e26ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227e6f6-8c90-4513-805a-35ca0f04aa32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c1e31-a25c-4a79-a4d6-7a17146b37cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[02556b2b-180c-41d8-b7f6-007551147740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:18:38 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:18:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b4979-9caa-404b-90f7-57e832858160]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG os_brick.utils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating existing volume attachment record: 9cfb34ad-6f97-40f3-a231-bc21b725309f {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updated VIF entry in instance network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG nova.network.neutron [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6ef29196-eb64-4b23-a831-f68e37956a9d req-2eba2895-1c6f-45fd-ba61-61ea002915b6 service nova] Releasing lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Successfully created port: 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] No waiting events found dispatching network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:40 user nova-compute[71269]: WARNING nova.compute.manager [req-35a68bfb-96ff-4716-9767-9c1ef998ee08 req-193b5c00-80c4-43bd-bcac-d93fde617410 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received unexpected event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 for instance with vm_state building and task_state spawning.
Apr 13 23:18:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Successfully updated port: 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG nova.network.neutron [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance network_info: |[{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427922.1293752, 06283ac1-5795-455d-9f85-38880202537f => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] VM Resumed (Lifecycle Event)
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] Instance spawned successfully.
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427922.1345525, 06283ac1-5795-455d-9f85-38880202537f => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] VM Started (Lifecycle Event)
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:18:42 user nova-compute[71269]: INFO nova.compute.manager [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Took 6.36 seconds to build instance.
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7fc38002-2131-4a20-a5a7-145a1545ae07 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] No waiting events found dispatching network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:42 user nova-compute[71269]: WARNING nova.compute.manager [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received unexpected event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 for instance with vm_state active and task_state None.
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing instance network info cache due to event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updated VIF entry in instance network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG nova.network.neutron [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:18:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fa3e3272-61ee-4647-af97-03b8ca9bd80d req-bcc908b8-0c99-4857-92ed-f6eae92dcd73 service nova] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:18:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Creating image(s)
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Ensure instance console log exists: /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start _get_guest_xml network_info=[{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '9cfb34ad-6f97-40f3-a231-bc21b725309f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04eb8a55-c6d2-4a80-a818-060635d757a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'serial': 'b88ed41a-5418-4d62-a2fa-2a20ebb28d61'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:18:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:18:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:18:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:18:43 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b24f7-02b0-4d9d-9a9f-9d227f598b02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:18:43 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b99e9-7c25-427c-9d36-dc80bc4619f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61] added
Apr 13 23:18:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[397076a6-21d0-42a8-9d78-18ce413e34f1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5161507b-2c63-437a-b314-2e3498d405ac]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfWpzODL {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfWpzODL" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25761de-fb69-4577-940e-9d1149751b71]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfWpzODL'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d969bd-7b4f-46f6-af34-67b5228beefd]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9304db1-6321-495f-929e-b91cf41e6f4e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4f544-0eec-475e-a28e-fa6baad7726b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]
Apr 13 23:18:43 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.
Apr 13 23:18:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8789a5-343a-4f84-abb4-ec865d936ab1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b937c0c-c300-4d6e-a63b-f1984b1c5ee5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:44 user nova-compute[71269]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:18:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:18:44 user nova-compute[71269]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:18:44 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fa3e45-e3d3-4613-8f63-a09c992c63cf]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:18:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23331313631353363', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331313631353363', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvcgABwMirIcE19N+aazLx0Zg51+obS69YGRl6d0PeLCmslra6FLm+QyggrY60hO14lhcjk64wNOa7203g364QXdlHw2OjXK932WJyS+1PEJhGR3jaPzH4rq5v9Sj3ICQ==',key_name='tempest-TestShelveInstance-1980593566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:18:39Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.objects.instance [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'pci_devices' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:18:45 user nova-compute[71269]:   <uuid>04eb8a55-c6d2-4a80-a818-060635d757a6</uuid>
Apr 13 23:18:45 user nova-compute[71269]:   <name>instance-0000002c</name>
Apr 13 23:18:45 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:18:45 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:18:45 user nova-compute[71269]:   <metadata>
Apr 13 23:18:45 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:18:45 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:18:45 user nova-compute[71269]:       <nova:name>tempest-TestShelveInstance-server-93864092</nova:name>
Apr 13 23:18:45 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:18:43</nova:creationTime>
Apr 13 23:18:45 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:18:45 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:18:45 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:18:45 user nova-compute[71269]:       <nova:owner>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:user uuid="271839d0073b49689368301d420c588a">tempest-TestShelveInstance-1015090248-project-member</nova:user>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:project uuid="405da8dd69654b3fb74203d0b7e26ad2">tempest-TestShelveInstance-1015090248</nova:project>
Apr 13 23:18:45 user nova-compute[71269]:       </nova:owner>
Apr 13 23:18:45 user nova-compute[71269]:       <nova:ports>
Apr 13 23:18:45 user nova-compute[71269]:         <nova:port uuid="60b18b3d-d206-49a4-81e4-f29a1b538a3c">
Apr 13 23:18:45 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:18:45 user nova-compute[71269]:         </nova:port>
Apr 13 23:18:45 user nova-compute[71269]:       </nova:ports>
Apr 13 23:18:45 user nova-compute[71269]:     </nova:instance>
Apr 13 23:18:45 user nova-compute[71269]:   </metadata>
Apr 13 23:18:45 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:18:45 user nova-compute[71269]:     <system>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="serial">04eb8a55-c6d2-4a80-a818-060635d757a6</entry>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="uuid">04eb8a55-c6d2-4a80-a818-060635d757a6</entry>
Apr 13 23:18:45 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:18:45 user nova-compute[71269]:     </system>
Apr 13 23:18:45 user nova-compute[71269]:   </sysinfo>
Apr 13 23:18:45 user nova-compute[71269]:   <os>
Apr 13 23:18:45 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:18:45 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:18:45 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:18:45 user nova-compute[71269]:   </os>
Apr 13 23:18:45 user nova-compute[71269]:   <features>
Apr 13 23:18:45 user nova-compute[71269]:     <acpi/>
Apr 13 23:18:45 user nova-compute[71269]:     <apic/>
Apr 13 23:18:45 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:18:45 user nova-compute[71269]:   </features>
Apr 13 23:18:45 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:18:45 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:18:45 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:18:45 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:18:45 user nova-compute[71269]:   </clock>
Apr 13 23:18:45 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:18:45 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:18:45 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:18:45 user nova-compute[71269]:   </cpu>
Apr 13 23:18:45 user nova-compute[71269]:   <devices>
Apr 13 23:18:45 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:18:45 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:18:45 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 23:18:45 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:18:45 user nova-compute[71269]:       <serial>b88ed41a-5418-4d62-a2fa-2a20ebb28d61</serial>
Apr 13 23:18:45 user nova-compute[71269]:     </disk>
Apr 13 23:18:45 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:18:45 user nova-compute[71269]:       <mac address="fa:16:3e:84:ae:97"/>
Apr 13 23:18:45 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:45 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:18:45 user nova-compute[71269]:       <target dev="tap60b18b3d-d2"/>
Apr 13 23:18:45 user nova-compute[71269]:     </interface>
Apr 13 23:18:45 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:18:45 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6/console.log" append="off"/>
Apr 13 23:18:45 user nova-compute[71269]:     </serial>
Apr 13 23:18:45 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:18:45 user nova-compute[71269]:     <video>
Apr 13 23:18:45 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:18:45 user nova-compute[71269]:     </video>
Apr 13 23:18:45 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:18:45 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:18:45 user nova-compute[71269]:     </rng>
Apr 13 23:18:45 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:18:45 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:18:45 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:18:45 user nova-compute[71269]:     </memballoon>
Apr 13 23:18:45 user nova-compute[71269]:   </devices>
Apr 13 23:18:45 user nova-compute[71269]: </domain>
Apr 13 23:18:45 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvcgABwMirIcE19N+aazLx0Zg51+obS69YGRl6d0PeLCmslra6FLm+QyggrY60hO14lhcjk64wNOa7203g364QXdlHw2OjXK932WJyS+1PEJhGR3jaPzH4rq5v9Sj3ICQ==',key_name='tempest-TestShelveInstance-1980593566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:18:39Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG os_vif [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60b18b3d-d2, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60b18b3d-d2, col_values=(('external_ids', {'iface-id': '60b18b3d-d206-49a4-81e4-f29a1b538a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ae:97', 'vm-uuid': '04eb8a55-c6d2-4a80-a818-060635d757a6'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:45 user nova-compute[71269]: INFO os_vif [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2')
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:18:45 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] No VIF found with MAC fa:16:3e:84:ae:97, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:46 user nova-compute[71269]: WARNING nova.compute.manager [req-78cb0760-0256-4e63-89b2-2bff13ca8969 req-864a892c-a136-40a3-8962-8d6e4cacf099 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state building and task_state spawning.
Apr 13 23:18:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:18:48 user nova-compute[71269]: WARNING nova.compute.manager [req-155c5e0d-5b89-4cf8-af88-9f20b7511fa9 req-a8142bab-7c43-471a-b662-4d18f97ed492 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state building and task_state spawning.
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427928.90896, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Resumed (Lifecycle Event)
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:18:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance spawned successfully.
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:18:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681427928.9121962, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:18:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Started (Lifecycle Event)
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:18:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:18:49 user nova-compute[71269]: INFO nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 13 23:18:49 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:18:49 user nova-compute[71269]: INFO nova.compute.manager [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Took 10.94 seconds to build instance.
Apr 13 23:18:49 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-cfd6b6a0-c7a2-42b3-ad0e-867595f10785 tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.068s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:18:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:53 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:18:53 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:18:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:54 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:18:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:18:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:19:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing instance network info cache due to event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:19:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:19:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:19:02 user nova-compute[71269]: DEBUG nova.network.neutron [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:19:03 user nova-compute[71269]: DEBUG nova.network.neutron [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updated VIF entry in instance network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:19:03 user nova-compute[71269]: DEBUG nova.network.neutron [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:19:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4de5edb6-9db9-4464-920e-d122a9833ddd req-b8c6fb29-3019-4c66-80e8-a97377932b90 service nova] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:19:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:19:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:06 user nova-compute[71269]: INFO nova.compute.manager [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Shelving
Apr 13 23:19:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:06 user nova-compute[71269]: DEBUG nova.compute.manager [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:19:06 user nova-compute[71269]: WARNING nova.compute.manager [req-42ec80e3-9a4c-4c59-a828-9d045b25879a req-437dcce6-f5cc-4dd0-8da1-ee011fdc130e service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state active and task_state shelving.
Apr 13 23:19:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance destroyed successfully.
Apr 13 23:19:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Beginning cold snapshot process
Apr 13 23:19:07 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk /opt/stack/data/nova/instances/snapshots/tmp5nxb2q5x/94c5b29207a5427cadb87eca32e6d0cb {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk /opt/stack/data/nova/instances/snapshots/tmp5nxb2q5x/94c5b29207a5427cadb87eca32e6d0cb" returned: 0 in 0.501s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:07 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Snapshot extracted, beginning image upload
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG nova.compute.manager [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:19:08 user nova-compute[71269]: WARNING nova.compute.manager [req-8ec462fd-5052-4075-9c6e-746fc9559e0f req-7840f415-2077-47c7-9719-7caf967de92d service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:19:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:19:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8268MB free_disk=26.142784118652344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 06283ac1-5795-455d-9f85-38880202537f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:19:09 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Snapshot image upload complete
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:09 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:19:10 user nova-compute[71269]: INFO nova.compute.manager [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Shelve offloading
Apr 13 23:19:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance destroyed successfully.
Apr 13 23:19:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG nova.network.neutron [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:19:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:19:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance destroyed successfully.
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'resources' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRHhnAKdZFUW2qGL3xJyfalvtnzUb12fQWEKaj1zVCyg5qFeLmoWDgWt5B/CDTEZ5VNMSCnig9fSEEvVhciP/p+fUw6A9lTrWimhc/xwqS7liP8+sW9m/AzIzM0EZ7OOg==',key_name='tempest-keypair-106580173',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:19:09.987584',shelved_host='user',shelved_image_id='0f079d22-f13a-4993-bd96-be4de613a1fb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG os_vif [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3a3698d-6a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing instance network info cache due to event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:19:11 user nova-compute[71269]: INFO os_vif [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a')
Apr 13 23:19:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Deleting instance files /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55_del
Apr 13 23:19:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Deletion of /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55_del complete
Apr 13 23:19:11 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Deleted allocations for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b54777fb-479c-4c61-bc09-383d60d339e6 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.241s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updated VIF entry in instance network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:19:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-89d48089-d288-44fa-91d4-5bb8c0297335 req-e72a9154-4282-4867-b8ea-66967b93cf29 service nova] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [{"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:22 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681427947.1056404, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:19:22 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Stopped (Lifecycle Event)
Apr 13 23:19:22 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f63b1d97-57b2-4ba8-9497-89c651f62f5d None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:19:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_power_states {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:19:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:19:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:19:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:03 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:03 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:20:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:07 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:20:09 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=26.161636352539062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 06283ac1-5795-455d-9f85-38880202537f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:20:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:20:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:20:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.compute.manager [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing instance network info cache due to event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Acquiring lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Acquired lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:28 user nova-compute[71269]: INFO nova.compute.manager [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Attaching volume a7a742f2-f8c8-494d-82a6-51ed6c32e3fe to /dev/vdb
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.utils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[43902586-4f54-431c-8503-9a6a5401dd30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf69a2-2350-48be-8832-16a8e4e20699]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca7c3a-c920-440d-be89-263bb8436c44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76ecdb-fcf1-44a5-86a5-0bc8f390264d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updated VIF entry in instance network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:20:28 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b47e8-beea-4454-b51a-993d9aa6018b]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG os_brick.utils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating existing volume attachment record: ce773a31-bb6b-4dbb-be79-1fc169a0b7c7 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:20:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-416eb36c-6543-4c6e-ab94-2be25f65091f req-2066fc0a-23c7-458b-bc24-4d46ea173491 service nova] Releasing lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing instance network info cache due to event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:29 user nova-compute[71269]: INFO nova.compute.manager [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Shelve offloading
Apr 13 23:20:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:20:30 user nova-compute[71269]: WARNING nova.compute.manager [req-9a030947-e88c-4060-a121-c153451707c7 req-06bef2e1-37d0-4fbe-a027-89cb16354e16 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state active and task_state shelving.
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updated VIF entry in instance network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.network.neutron [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6796c7c9-1fe8-438b-a888-c365a54e1304 req-1304ea3c-3e11-4d5e-99de-3dc13b6f711d service nova] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:20:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance destroyed successfully.
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:20:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:20:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:20:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance destroyed successfully.
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'resources' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvcgABwMirIcE19N+aazLx0Zg51+obS69YGRl6d0PeLCmslra6FLm+QyggrY60hO14lhcjk64wNOa7203g364QXdlHw2OjXK932WJyS+1PEJhGR3jaPzH4rq5v9Sj3ICQ==',key_name='tempest-TestShelveInstance-1980593566',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:49Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_vif [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b18b3d-d2, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing instance network info cache due to event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:32 user nova-compute[71269]: INFO os_vif [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2')
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:32 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b674b6-a9bd-4a23-8f9c-a83364df44e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:20:32 user nova-compute[71269]: No targets found.
Apr 13 23:20:32 user nova-compute[71269]: iSNS:
Apr 13 23:20:32 user nova-compute[71269]: No targets found.
Apr 13 23:20:32 user nova-compute[71269]: STATIC:
Apr 13 23:20:32 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61
Apr 13 23:20:32 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:20:32 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:20:32 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:20:32 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:20:32 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:20:32 user nova-compute[71269]: FIRMWARE:
Apr 13 23:20:32 user nova-compute[71269]: No targets found.
Apr 13 23:20:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:20:32 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:20:32 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[997170f5-c1a5-4b32-85e5-9213c39a4c2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6cb672-5e75-4f50-a01a-0e282ce7658e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:32 user nova-compute[71269]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:20:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:32 user nova-compute[71269]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:20:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[260516b0-89c6-4446-9476-ee4ae531264f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771f067-dbaa-4812-9961-356003b041bc]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81befd24-3a36-4302-8c70-f638b660298e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fe7bb4-c168-42a4-adc0-f8f52bce3a55]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e936d14-8eb9-41df-8369-4d17cbdd6b7b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:20:32 user nova-compute[71269]: WARNING nova.compute.manager [req-e46a5adf-bf38-4532-91e6-5242c1d1bfc1 req-a72b00ac-e21f-46a7-b7d9-f242209b286f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state active and task_state shelving.
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45182a-de0e-47f5-bce2-f6009085259e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]
Apr 13 23:20:32 user nova-compute[71269]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.
Apr 13 23:20:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[69199bb3-b8d5-4159-b465-b4281f50ecf1]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== disconnect_volume: return (350ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:20:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deleting instance files /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6_del
Apr 13 23:20:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deletion of /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6_del complete
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updated VIF entry in instance network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": null, "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4aa8c8c6-5c31-436b-83cc-f5fe0bb70ef7 req-8f02e5c3-88d2-4a21-b942-95509dfbbf0a service nova] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSiWrmME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:33 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:20:33 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:20:33 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[932374b0-c5cf-4063-a745-acc37e093d83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:20:33 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f25db2-a601-4e3a-a70e-dd4324e7dd76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe] added
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa3411-0826-4101-97d5-d1fe7d40d8eb]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ce406-121f-4a48-baf1-630d1e48961b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSiWrmME {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fSiWrmME" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef39263-39f3-4f0a-8aa1-213da77e3093]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fSiWrmME'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80691b8a-04f8-4bc2-b964-9a7e4bdec5c7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8cad43-9b52-4f3f-978d-bd9d19a28b54]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a1a3a0-a36e-4fc5-b268-3aed3006aee9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260]
Apr 13 23:20:33 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260] successful.
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[808a15d9-a0c2-4fe4-bcb9-fa950ccda467]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d5dabe-3017-4498-a2d5-cd5676722901]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:33 user nova-compute[71269]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:33 user nova-compute[71269]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)
Apr 13 23:20:33 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c8e0c-ee27-4d49-bfc0-0e060dc87c57]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSiWrmME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:20:33 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Deleted allocations for instance 04eb8a55-c6d2-4a80-a818-060635d757a6
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:33 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'numa_topology' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfc5f-68c0-4ff6-a567-c0ac254a303f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.151s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23939343362373264', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939343362373264', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 23:20:34 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:20:34 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:20:34 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:20:34 user nova-compute[71269]:   <serial>a7a742f2-f8c8-494d-82a6-51ed6c32e3fe</serial>
Apr 13 23:20:34 user nova-compute[71269]: </disk>
Apr 13 23:20:34 user nova-compute[71269]:  {{(pid=71269) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 23:20:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:20:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:20:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] No VIF found with MAC fa:16:3e:d5:0f:76, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:20:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-7a4bad6f-8f7e-4ae8-b7be-9ab544477e2e tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.812s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:36 user nova-compute[71269]: INFO nova.compute.manager [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Detaching volume a7a742f2-f8c8-494d-82a6-51ed6c32e3fe
Apr 13 23:20:36 user nova-compute[71269]: INFO nova.virt.block_device [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Attempting to driver detach volume a7a742f2-f8c8-494d-82a6-51ed6c32e3fe from mountpoint /dev/vdb
Apr 13 23:20:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Attempting to detach device vdb from instance 06283ac1-5795-455d-9f85-38880202537f from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:20:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:20:36 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:20:36 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:20:36 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:20:36 user nova-compute[71269]:   <serial>a7a742f2-f8c8-494d-82a6-51ed6c32e3fe</serial>
Apr 13 23:20:36 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:20:36 user nova-compute[71269]: </disk>
Apr 13 23:20:36 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:20:36 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully detached device vdb from instance 06283ac1-5795-455d-9f85-38880202537f from the persistent domain config.
Apr 13 23:20:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06283ac1-5795-455d-9f85-38880202537f from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:20:36 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:20:36 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:20:36 user nova-compute[71269]:   <source dev="/dev/sdc"/>
Apr 13 23:20:36 user nova-compute[71269]:   <target dev="vdb" bus="virtio"/>
Apr 13 23:20:36 user nova-compute[71269]:   <serial>a7a742f2-f8c8-494d-82a6-51ed6c32e3fe</serial>
Apr 13 23:20:36 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 23:20:36 user nova-compute[71269]: </disk>
Apr 13 23:20:36 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681428037.0170956, 06283ac1-5795-455d-9f85-38880202537f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:20:37 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully detached device vdb from instance 06283ac1-5795-455d-9f85-38880202537f from the live domain config.
Apr 13 23:20:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fSiWrmME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:37 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0413a-d2de-4051-9e59-d2e4c88e9f8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:20:37 user nova-compute[71269]: No targets found.
Apr 13 23:20:37 user nova-compute[71269]: iSNS:
Apr 13 23:20:37 user nova-compute[71269]: No targets found.
Apr 13 23:20:37 user nova-compute[71269]: STATIC:
Apr 13 23:20:37 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe
Apr 13 23:20:37 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:20:37 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:20:37 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:20:37 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:20:37 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:20:37 user nova-compute[71269]: FIRMWARE:
Apr 13 23:20:37 user nova-compute[71269]: No targets found.
Apr 13 23:20:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:20:37 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:20:37 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[db24b844-4ce2-4a1e-83d8-fa961f4392d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c49aaa-7565-423b-9847-9efde006ab7e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:37 user nova-compute[71269]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)
Apr 13 23:20:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:37 user nova-compute[71269]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe (non-flash)
Apr 13 23:20:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc396170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea331f2-ab90-405b-822c-932db4105d2c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[568fd07e-6ac0-4414-8afe-385ad142c9ce]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3341cd11-3f33-4b55-a251-2bd05b31b00b]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf9d1e1-d2be-4b0c-9b5c-3438b6877731]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.062s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8fab5d-f680-4816-adbb-1fed2abe3b93]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8713ec49-f222-4900-be6a-5adc74ac9734]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260]
Apr 13 23:20:37 user nova-compute[71269]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe, portal: 172.16.0.220,3260] successful.
Apr 13 23:20:37 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a742f2-f8c8-494d-82a6-51ed6c32e3fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bcd08-057a-4960-ac5f-c125a0e32221]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] <== disconnect_volume: return (339ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:20:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'flavor' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-e8e2bf96-2539-44db-8f14-1e30e4ceffbc tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:45 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428030.7496073, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:20:45 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Stopped (Lifecycle Event)
Apr 13 23:20:45 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e98f36c6-62ac-438d-9df4-7f7a82b84f4c None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:20:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:51 user nova-compute[71269]: INFO nova.compute.manager [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Terminating instance
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.compute.manager [req-16d5f53e-3e9a-48fe-940a-a4a866b6ab99 req-de2eff57-b806-480e-9e37-f38dca9ee704 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-unplugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:20:51 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Instance destroyed successfully.
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.objects.instance [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1074557247',display_name='tempest-ServerActionsTestJSON-server-19843969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1074557247',id=33,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-sjku2i9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "09cc0c17-bd49-4207-9de4-89178a1e681e", "address": "fa:16:3e:23:cf:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc0c17-bd", "ovs_interfaceid": "09cc0c17-bd49-4207-9de4-89178a1e681e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_vif [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09cc0c17-bd, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:20:51 user nova-compute[71269]: INFO os_vif [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:cf:d9,bridge_name='br-int',has_traffic_filtering=True,id=09cc0c17-bd49-4207-9de4-89178a1e681e,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc0c17-bd')
Apr 13 23:20:51 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzpRBCtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:51 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fc0f46-2784-49ef-b759-089cf0f4bb07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:20:51 user nova-compute[71269]: No targets found.
Apr 13 23:20:51 user nova-compute[71269]: iSNS:
Apr 13 23:20:51 user nova-compute[71269]: No targets found.
Apr 13 23:20:51 user nova-compute[71269]: STATIC:
Apr 13 23:20:51 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18
Apr 13 23:20:51 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:20:51 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:20:51 user nova-compute[71269]: FIRMWARE:
Apr 13 23:20:51 user nova-compute[71269]: No targets found.
Apr 13 23:20:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:20:51 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:20:51 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e5772-4b32-4c2b-bb8b-28f5b6dd53dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[509b242f-104d-4e10-ac7a-ae296f131d17]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 (non-flash)
Apr 13 23:20:51 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c6b49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f469ae4-6daf-4c64-926a-16355401def3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8affb551-180a-46b2-bb0e-6eb2b037eb5e]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd348e-3d19-400b-a2aa-1d92d985b17f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab9b978-1548-440f-9749-89b0247d6c79]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:20:51 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef2dbc7-be58-4b93-95f3-e5adba999b2c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fcbc06-d90d-466f-874a-3bbe261e6458]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260]
Apr 13 23:20:52 user nova-compute[71269]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18, portal: 172.16.0.220,3260] successful.
Apr 13 23:20:52 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4e4a35-555c-4395-acaf-17e3d7446b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b30d1-2765-49e1-867c-7bcd5db9b2d5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (300ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:20:52 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Deleting instance files /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_del
Apr 13 23:20:52 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Deletion of /opt/stack/data/nova/instances/d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d_del complete
Apr 13 23:20:52 user nova-compute[71269]: INFO nova.compute.manager [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 13 23:20:52 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:52 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Took 0.67 seconds to deallocate network for instance.
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-deleted-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:52 user nova-compute[71269]: INFO nova.compute.manager [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Neutron deleted interface 09cc0c17-bd49-4207-9de4-89178a1e681e; detaching it from the instance and deleting it from the info cache
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.network.neutron [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:20:52 user nova-compute[71269]: DEBUG nova.compute.manager [req-e9a5e34d-1362-43df-9c63-a545107987f3 req-3da69b29-ade2-4f39-8aab-05c00fc97ab7 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Detach interface failed, port_id=09cc0c17-bd49-4207-9de4-89178a1e681e, reason: Instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Acquiring lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG nova.compute.manager [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] No waiting events found dispatching network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:20:53 user nova-compute[71269]: WARNING nova.compute.manager [req-99c691bd-c0c1-4e8c-9678-cd720765cd16 req-93e03a1c-73c3-47e8-b127-81d9041d40e1 service nova] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Received unexpected event network-vif-plugged-09cc0c17-bd49-4207-9de4-89178a1e681e for instance with vm_state active and task_state deleting.
Apr 13 23:20:53 user nova-compute[71269]: INFO nova.compute.manager [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Took 0.88 seconds to detach 1 volumes for instance.
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:20:53 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:53 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Deleted allocations for instance d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d
Apr 13 23:20:54 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-c47759b7-6e82-47c1-a69b-e07fe72df32d tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:20:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:20:58 user nova-compute[71269]: INFO nova.compute.manager [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Unshelving
Apr 13 23:20:58 user nova-compute[71269]: INFO nova.virt.block_device [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Booting with volume f353a28d-41ad-4994-b1ad-c46d03702c33 at /dev/vdc
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.utils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8492246-0872-4e2a-9407-8dd80d4a47c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40671303-9504-41ce-991e-0fc2a05d1e2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf43ff8-0ab1-440f-a882-92c703f4e39c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff339738-db7f-4ea1-855a-d0f4ba84f71b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:20:58 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:20:58 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51956c6e-8a7f-4fa6-9db1-7744fca01337]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG os_brick.utils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:20:58 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating existing volume attachment record: 09ee9477-4212-47e3-abb8-380a5be5d4b1 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:20:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_requests' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:21:03 user nova-compute[71269]: INFO nova.compute.claims [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Claim successful on node user
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:03 user nova-compute[71269]: INFO nova.network.neutron [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating port b3a3698d-6a99-43ff-8298-a59026248b01 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing instance network info cache due to event network-changed-b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:21:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Acquiring lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG nova.network.neutron [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:21:04 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Creating image(s)
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Acquired lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Refreshing network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "1e3bbbc23616c746675abe69138828b7608af7fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "1e3bbbc23616c746675abe69138828b7608af7fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.part --force-share --output=json" returned: 0 in 0.150s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG nova.virt.images [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] 0f079d22-f13a-4993-bd96-be4de613a1fb was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.part /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updated VIF entry in instance network info cache for port b3a3698d-6a99-43ff-8298-a59026248b01. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG nova.network.neutron [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-4bf890d9-2efb-40a4-a9de-053d10bacf39 req-bd6ff97d-7455-48c0-a366-b309c8e40a86 service nova] Releasing lock "refresh_cache-7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.part /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.converted" returned: 0 in 0.546s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "1e3bbbc23616c746675abe69138828b7608af7fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.608s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:05 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "1e3bbbc23616c746675abe69138828b7608af7fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "1e3bbbc23616c746675abe69138828b7608af7fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json" returned: 0 in 0.131s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc,backing_fmt=raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc,backing_fmt=raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk 1073741824" returned: 0 in 0.054s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "1e3bbbc23616c746675abe69138828b7608af7fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc --force-share --output=json" returned: 0 in 0.146s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'migration_context' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:06 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Rebasing disk image.
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f -F raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428051.745011, d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:06 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] VM Stopped (Lifecycle Event)
Apr 13 23:21:06 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f19c9dfe-f1f3-4d43-89d0-5b609d7fc657 None None] [instance: d3b4e1d5-1dce-4a64-8e09-68fadfe79a0d] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f -F raw /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk" returned: 0 in 1.941s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Ensure instance console log exists: /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start _get_guest_xml network_info=[{"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='26de2dc7ef9b980a9c87090bafe107fc',container_format='bare',created_at=2023-04-13T23:19:06Z,direct_url=<?>,disk_format='qcow2',id=0f079d22-f13a-4993-bd96-be4de613a1fb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-567976838-shelved',owner='b9ad0d0e72ad43cca506267d62269910',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T23:19:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '09ee9477-4212-47e3-abb8-380a5be5d4b1', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'febryjAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55', 'attached_at': '', 'detached_at': '', 'volume_id': 'f353a28d-41ad-4994-b1ad-c46d03702c33', 'serial': 'f353a28d-41ad-4994-b1ad-c46d03702c33'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:21:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:08 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='26de2dc7ef9b980a9c87090bafe107fc',container_format='bare',created_at=2023-04-13T23:19:06Z,direct_url=<?>,disk_format='qcow2',id=0f079d22-f13a-4993-bd96-be4de613a1fb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-567976838-shelved',owner='b9ad0d0e72ad43cca506267d62269910',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T23:19:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'febryjAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:21:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:21:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:21:08 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeddf932-492a-4b72-8509-db8ed816c8d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:21:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b151602d-ad42-4f05-b176-7bf1329df66f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33] added
Apr 13 23:21:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f767d883-96e5-428e-9669-7569a1198fe2]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[673dc784-c905-463a-be47-d16955247e70]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v febryjAv {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v febryjAv" returned: 0 in 0.023s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac0eff2-e003-4d8b-b301-4771c2b4dc71]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'febryjAv'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902f7be-fd86-498a-935c-82005c23cb91]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa076bb0-5a6c-47c8-a1e9-7a922f16b60d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:21:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:21:08 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:21:08 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 23:21:08 user nova-compute[71269]: 
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7af85-3eba-415d-880e-b5e6f308d7e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260]
Apr 13 23:21:08 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260] successful.
Apr 13 23:21:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9a643-620a-4931-b173-2edf9ecdefda]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1e2d8-d9fa-4979-a248-148d90bb145d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:21:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:21:08 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37944576-5fe0-4fff-b69a-22d31bb75eb0]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:21:08 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'febryjAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26663353335356437', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663353335356437', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:21:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=26.07549285888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='0f079d22-f13a-4993-bd96-be4de613a1fb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-106580173',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:19:09.987584',shelved_host='user',shelved_image_id='0f079d22-f13a-4993-bd96-be4de613a1fb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:20:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:21:10 user nova-compute[71269]:   <uuid>7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</uuid>
Apr 13 23:21:10 user nova-compute[71269]:   <name>instance-0000002a</name>
Apr 13 23:21:10 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:21:10 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:21:10 user nova-compute[71269]:   <metadata>
Apr 13 23:21:10 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:21:10 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-567976838</nova:name>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:21:08</nova:creationTime>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:21:10 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:21:10 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:owner>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:user uuid="e66f624501c3404bb1eb9412a8a6c951">tempest-AttachVolumeShelveTestJSON-953327095-project-member</nova:user>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:project uuid="b9ad0d0e72ad43cca506267d62269910">tempest-AttachVolumeShelveTestJSON-953327095</nova:project>
Apr 13 23:21:10 user nova-compute[71269]:       </nova:owner>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:root type="image" uuid="0f079d22-f13a-4993-bd96-be4de613a1fb"/>
Apr 13 23:21:10 user nova-compute[71269]:       <nova:ports>
Apr 13 23:21:10 user nova-compute[71269]:         <nova:port uuid="b3a3698d-6a99-43ff-8298-a59026248b01">
Apr 13 23:21:10 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 23:21:10 user nova-compute[71269]:         </nova:port>
Apr 13 23:21:10 user nova-compute[71269]:       </nova:ports>
Apr 13 23:21:10 user nova-compute[71269]:     </nova:instance>
Apr 13 23:21:10 user nova-compute[71269]:   </metadata>
Apr 13 23:21:10 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:21:10 user nova-compute[71269]:     <system>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="serial">7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</entry>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="uuid">7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55</entry>
Apr 13 23:21:10 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:21:10 user nova-compute[71269]:     </system>
Apr 13 23:21:10 user nova-compute[71269]:   </sysinfo>
Apr 13 23:21:10 user nova-compute[71269]:   <os>
Apr 13 23:21:10 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:21:10 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:21:10 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:21:10 user nova-compute[71269]:   </os>
Apr 13 23:21:10 user nova-compute[71269]:   <features>
Apr 13 23:21:10 user nova-compute[71269]:     <acpi/>
Apr 13 23:21:10 user nova-compute[71269]:     <apic/>
Apr 13 23:21:10 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:21:10 user nova-compute[71269]:   </features>
Apr 13 23:21:10 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:21:10 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:21:10 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:21:10 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:21:10 user nova-compute[71269]:   </clock>
Apr 13 23:21:10 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:21:10 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:21:10 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:21:10 user nova-compute[71269]:   </cpu>
Apr 13 23:21:10 user nova-compute[71269]:   <devices>
Apr 13 23:21:10 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:21:10 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:21:10 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk"/>
Apr 13 23:21:10 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:21:10 user nova-compute[71269]:     </disk>
Apr 13 23:21:10 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:21:10 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:21:10 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:21:10 user nova-compute[71269]:       <target dev="vdc" bus="virtio"/>
Apr 13 23:21:10 user nova-compute[71269]:       <serial>f353a28d-41ad-4994-b1ad-c46d03702c33</serial>
Apr 13 23:21:10 user nova-compute[71269]:     </disk>
Apr 13 23:21:10 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:21:10 user nova-compute[71269]:       <mac address="fa:16:3e:45:1b:fe"/>
Apr 13 23:21:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:21:10 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:21:10 user nova-compute[71269]:       <target dev="tapb3a3698d-6a"/>
Apr 13 23:21:10 user nova-compute[71269]:     </interface>
Apr 13 23:21:10 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:21:10 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/console.log" append="off"/>
Apr 13 23:21:10 user nova-compute[71269]:     </serial>
Apr 13 23:21:10 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:21:10 user nova-compute[71269]:     <video>
Apr 13 23:21:10 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:21:10 user nova-compute[71269]:     </video>
Apr 13 23:21:10 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:21:10 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:21:10 user nova-compute[71269]:     </rng>
Apr 13 23:21:10 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:21:10 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:21:10 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:21:10 user nova-compute[71269]:     </memballoon>
Apr 13 23:21:10 user nova-compute[71269]:   </devices>
Apr 13 23:21:10 user nova-compute[71269]: </domain>
Apr 13 23:21:10 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='0f079d22-f13a-4993-bd96-be4de613a1fb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-106580173',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:19:09.987584',shelved_host='user',shelved_image_id='0f079d22-f13a-4993-bd96-be4de613a1fb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:20:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG os_vif [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3a3698d-6a, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3a3698d-6a, col_values=(('external_ids', {'iface-id': 'b3a3698d-6a99-43ff-8298-a59026248b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:1b:fe', 'vm-uuid': '7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:10 user nova-compute[71269]: INFO os_vif [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a')
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 06283ac1-5795-455d-9f85-38880202537f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (e216f943-de42-42dc-843a-799496cf2730): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No VIF found with MAC fa:16:3e:45:1b:fe, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:21:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:11 user nova-compute[71269]: WARNING nova.compute.manager [req-2a3499b7-618a-49c6-966d-e0cf29532ba3 req-0c45037d-eb8d-4a47-be45-4353427e4139 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:11 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:21:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:21:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428073.6425934, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Resumed (Lifecycle Event)
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:21:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance spawned successfully.
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:21:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428073.6436532, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Started (Lifecycle Event)
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:21:13 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:13 user nova-compute[71269]: WARNING nova.compute.manager [req-85c87be4-4265-4fae-b438-25020f3293d8 req-aac2b3bd-e6db-47b8-ab05-15b885976531 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 23:21:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-4b87a668-af89-4c3b-9c52-e0c1b8c6045e tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.604s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:18 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:21:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing instance network info cache due to event network-changed-5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Acquiring lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Acquired lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Refreshing network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:27 user nova-compute[71269]: INFO nova.compute.manager [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Terminating instance
Apr 13 23:21:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] Instance destroyed successfully.
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'resources' on Instance uuid 06283ac1-5795-455d-9f85-38880202537f {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1940780057',display_name='tempest-TestStampPattern-server-1940780057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1940780057',id=43,image_ref='59b1def6-7e36-4983-81ea-7b924ee9a11c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-h76e5udg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f522c0be-7d51-421c-8d6c-d01ce6f6eb26',image_min_disk='1',image_min_ram='0',image_owner_id='a71645bbbfcc4e41994fe910043ca0dd',image_owner_project_name='tempest-TestStampPattern-1517924890',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1517924890-project-member',image_user_id='17551363dd9f4e219ad7198b21509e48',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:42Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=06283ac1-5795-455d-9f85-38880202537f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG os_vif [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fc574ab-be, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:21:28 user nova-compute[71269]: INFO os_vif [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:0f:76,bridge_name='br-int',has_traffic_filtering=True,id=5fc574ab-be44-4634-ba3f-ac0faf630044,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc574ab-be')
Apr 13 23:21:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Deleting instance files /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f_del
Apr 13 23:21:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Deletion of /opt/stack/data/nova/instances/06283ac1-5795-455d-9f85-38880202537f_del complete
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updated VIF entry in instance network info cache for port 5fc574ab-be44-4634-ba3f-ac0faf630044. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.neutron [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [{"id": "5fc574ab-be44-4634-ba3f-ac0faf630044", "address": "fa:16:3e:d5:0f:76", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc574ab-be", "ovs_interfaceid": "5fc574ab-be44-4634-ba3f-ac0faf630044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9c392f68-61d8-4197-8792-2353cbbf58ad req-2b0a041a-7ae5-478d-9069-bbcc410bfd8c service nova] Releasing lock "refresh_cache-06283ac1-5795-455d-9f85-38880202537f" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:28 user nova-compute[71269]: INFO nova.compute.manager [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: 06283ac1-5795-455d-9f85-38880202537f] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 23:21:28 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:28 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] Took 0.56 seconds to deallocate network for instance.
Apr 13 23:21:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:28 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:29 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Deleted allocations for instance 06283ac1-5795-455d-9f85-38880202537f
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-8989d067-831d-4ac8-bf8d-6894e77821d3 tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "06283ac1-5795-455d-9f85-38880202537f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-vif-unplugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] No waiting events found dispatching network-vif-unplugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:29 user nova-compute[71269]: WARNING nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received unexpected event network-vif-unplugged-5fc574ab-be44-4634-ba3f-ac0faf630044 for instance with vm_state deleted and task_state None.
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Acquiring lock "06283ac1-5795-455d-9f85-38880202537f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] Lock "06283ac1-5795-455d-9f85-38880202537f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] No waiting events found dispatching network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:29 user nova-compute[71269]: WARNING nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received unexpected event network-vif-plugged-5fc574ab-be44-4634-ba3f-ac0faf630044 for instance with vm_state deleted and task_state None.
Apr 13 23:21:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-44c7c1e6-0a68-4946-94a3-f0aca48e6376 req-ec4c4d8e-3a69-48c6-bfcf-a59755ddc9cb service nova] [instance: 06283ac1-5795-455d-9f85-38880202537f] Received event network-vif-deleted-5fc574ab-be44-4634-ba3f-ac0faf630044 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:21:42 user nova-compute[71269]: INFO nova.compute.claims [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Claim successful on node user
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:21:42 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:21:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.policy [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:21:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Creating image(s)
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "/opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428088.205641, 06283ac1-5795-455d-9f85-38880202537f => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:43 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 06283ac1-5795-455d-9f85-38880202537f] VM Stopped (Lifecycle Event)
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-e7abf79d-c368-4a0c-923e-40f2fe53af1c None None] [instance: 06283ac1-5795-455d-9f85-38880202537f] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk 1073741824" returned: 0 in 0.052s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Cannot resize image /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'migration_context' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Ensure instance console log exists: /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:43 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Successfully created port: 1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Successfully updated port: 1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.compute.manager [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.compute.manager [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing instance network info cache due to event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Instance network_info: |[{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.neutron [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Start _get_guest_xml network_info=[{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:21:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:44 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-545240224',display_name='tempest-ServerActionsTestJSON-server-545240224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-545240224',id=45,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-35my7br9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=b5af8749-cd19-4828-b6f6-e3628da12f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:21:44 user nova-compute[71269]:   <uuid>b5af8749-cd19-4828-b6f6-e3628da12f01</uuid>
Apr 13 23:21:44 user nova-compute[71269]:   <name>instance-0000002d</name>
Apr 13 23:21:44 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:21:44 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:21:44 user nova-compute[71269]:   <metadata>
Apr 13 23:21:44 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:21:44 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-545240224</nova:name>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:21:44</nova:creationTime>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:21:44 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:21:44 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:owner>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:21:44 user nova-compute[71269]:       </nova:owner>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:21:44 user nova-compute[71269]:       <nova:ports>
Apr 13 23:21:44 user nova-compute[71269]:         <nova:port uuid="1f5d0400-132c-4746-9b98-a86dfc3511af">
Apr 13 23:21:44 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 23:21:44 user nova-compute[71269]:         </nova:port>
Apr 13 23:21:44 user nova-compute[71269]:       </nova:ports>
Apr 13 23:21:44 user nova-compute[71269]:     </nova:instance>
Apr 13 23:21:44 user nova-compute[71269]:   </metadata>
Apr 13 23:21:44 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:21:44 user nova-compute[71269]:     <system>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="serial">b5af8749-cd19-4828-b6f6-e3628da12f01</entry>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="uuid">b5af8749-cd19-4828-b6f6-e3628da12f01</entry>
Apr 13 23:21:44 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:21:44 user nova-compute[71269]:     </system>
Apr 13 23:21:44 user nova-compute[71269]:   </sysinfo>
Apr 13 23:21:44 user nova-compute[71269]:   <os>
Apr 13 23:21:44 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:21:44 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:21:44 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:21:44 user nova-compute[71269]:   </os>
Apr 13 23:21:44 user nova-compute[71269]:   <features>
Apr 13 23:21:44 user nova-compute[71269]:     <acpi/>
Apr 13 23:21:44 user nova-compute[71269]:     <apic/>
Apr 13 23:21:44 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:21:44 user nova-compute[71269]:   </features>
Apr 13 23:21:44 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:21:44 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:21:44 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:21:44 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:21:44 user nova-compute[71269]:   </clock>
Apr 13 23:21:44 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:21:44 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:21:44 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:21:44 user nova-compute[71269]:   </cpu>
Apr 13 23:21:44 user nova-compute[71269]:   <devices>
Apr 13 23:21:44 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:21:44 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:21:44 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk"/>
Apr 13 23:21:44 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:21:44 user nova-compute[71269]:     </disk>
Apr 13 23:21:44 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:21:44 user nova-compute[71269]:       <mac address="fa:16:3e:b3:f5:1f"/>
Apr 13 23:21:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:21:44 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:21:44 user nova-compute[71269]:       <target dev="tap1f5d0400-13"/>
Apr 13 23:21:44 user nova-compute[71269]:     </interface>
Apr 13 23:21:44 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:21:44 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/console.log" append="off"/>
Apr 13 23:21:44 user nova-compute[71269]:     </serial>
Apr 13 23:21:44 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:21:44 user nova-compute[71269]:     <video>
Apr 13 23:21:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:21:44 user nova-compute[71269]:     </video>
Apr 13 23:21:44 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:21:44 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:21:44 user nova-compute[71269]:     </rng>
Apr 13 23:21:44 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:21:44 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:21:44 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:21:44 user nova-compute[71269]:     </memballoon>
Apr 13 23:21:44 user nova-compute[71269]:   </devices>
Apr 13 23:21:44 user nova-compute[71269]: </domain>
Apr 13 23:21:44 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-545240224',display_name='tempest-ServerActionsTestJSON-server-545240224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-545240224',id=45,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-35my7br9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=b5af8749-cd19-4828-b6f6-e3628da12f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG os_vif [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f5d0400-13, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f5d0400-13, col_values=(('external_ids', {'iface-id': '1f5d0400-132c-4746-9b98-a86dfc3511af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:f5:1f', 'vm-uuid': 'b5af8749-cd19-4828-b6f6-e3628da12f01'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:44 user nova-compute[71269]: INFO os_vif [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13')
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:21:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:b3:f5:1f, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:21:45 user nova-compute[71269]: DEBUG nova.network.neutron [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated VIF entry in instance network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:21:45 user nova-compute[71269]: DEBUG nova.network.neutron [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:21:45 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-1a2cf5a2-fd6c-48cf-b7ef-aad4e2961914 req-3a72c1b8-d674-4a77-9c60-faef6d7d385b service nova] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] No waiting events found dispatching network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:46 user nova-compute[71269]: WARNING nova.compute.manager [req-bafaa4e0-e9fb-4b16-b4c5-c81722588c53 req-9d86e5e0-6346-4ce6-9460-0ccde448a55b service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received unexpected event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af for instance with vm_state building and task_state spawning.
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428108.3528385, b5af8749-cd19-4828-b6f6-e3628da12f01 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] VM Resumed (Lifecycle Event)
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Instance spawned successfully.
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428108.3548148, b5af8749-cd19-4828-b6f6-e3628da12f01 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] VM Started (Lifecycle Event)
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:21:48 user nova-compute[71269]: INFO nova.compute.manager [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Took 5.95 seconds to build instance.
Apr 13 23:21:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1abe1e25-18e1-473c-86fc-9ec1bcc63f25 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.042s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:21:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] No waiting events found dispatching network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:21:48 user nova-compute[71269]: WARNING nova.compute.manager [req-a3f22d19-bfb9-4442-bc6a-6600d89164ad req-52cf18df-6f76-41d5-b0be-440ec51e2862 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received unexpected event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af for instance with vm_state active and task_state None.
Apr 13 23:21:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:21:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:04 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:04 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:22:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:08 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:22:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=26.125858306884766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:22:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:22:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 23:22:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:22:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:22:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:21 user nova-compute[71269]: INFO nova.compute.manager [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Unshelving
Apr 13 23:22:21 user nova-compute[71269]: INFO nova.virt.block_device [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Booting with volume b88ed41a-5418-4d62-a2fa-2a20ebb28d61 at /dev/vda
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.utils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac18b837-ab51-4dd0-a1bc-3a7843012d4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c0313-f2d5-4117-bcc8-4de1f17c7e8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03d171-130b-49ad-bfbe-bd1fc394ac27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9ed1fc-6678-4285-bf79-3e482f6845d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:22:21 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:22:21 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff70db-ab53-492a-b562-83440ee5bf24]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG os_brick.utils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:22:21 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating existing volume attachment record: 3f1685e4-4b5e-49d3-87a6-aad0e6f9a965 {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:22:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:22 user nova-compute[71269]: DEBUG nova.compute.manager [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing instance network info cache due to event network-changed-319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:22:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Acquiring lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:22:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Acquired lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:22:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Refreshing network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:23 user nova-compute[71269]: INFO nova.compute.manager [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Terminating instance
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updated VIF entry in instance network info cache for port 319f1294-7d2b-4725-8ecd-a21ef3df06e8. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [{"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:22:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Instance destroyed successfully.
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lazy-loading 'resources' on Instance uuid f522c0be-7d51-421c-8d6c-d01ce6f6eb26 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-743d6355-0318-4aa3-a2eb-752faa301551 req-7287bd35-a88c-4238-bdd3-29be303052f9 service nova] Releasing lock "refresh_cache-f522c0be-7d51-421c-8d6c-d01ce6f6eb26" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1291739265',display_name='tempest-TestStampPattern-server-1291739265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1291739265',id=41,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxngmtHMJIADwXoPdcP64dxJrdZcaQq8ZVb5LBBk6F0TkqkReYSndg67icZJTwj7D2TIUZMiTemX6uBfFkKD0HqzbnjwwgnGTBQZoTeuc/1Bea3ZpvzfMXUi7CmzqHVvA==',key_name='tempest-TestStampPattern-668013808',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:15:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a71645bbbfcc4e41994fe910043ca0dd',ramdisk_id='',reservation_id='r-ova767sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1517924890',owner_user_name='tempest-TestStampPattern-1517924890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:18:30Z,user_data=None,user_id='17551363dd9f4e219ad7198b21509e48',uuid=f522c0be-7d51-421c-8d6c-d01ce6f6eb26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converting VIF {"id": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "address": "fa:16:3e:49:ba:a6", "network": {"id": "077aa2c8-8cb6-4692-92ba-82064a0163d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1932710570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71645bbbfcc4e41994fe910043ca0dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap319f1294-7d", "ovs_interfaceid": "319f1294-7d2b-4725-8ecd-a21ef3df06e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG os_vif [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap319f1294-7d, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:23 user nova-compute[71269]: INFO os_vif [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=319f1294-7d2b-4725-8ecd-a21ef3df06e8,network=Network(077aa2c8-8cb6-4692-92ba-82064a0163d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap319f1294-7d')
Apr 13 23:22:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Deleting instance files /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26_del
Apr 13 23:22:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Deletion of /opt/stack/data/nova/instances/f522c0be-7d51-421c-8d6c-d01ce6f6eb26_del complete
Apr 13 23:22:23 user nova-compute[71269]: INFO nova.compute.manager [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 23:22:23 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:22:23 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:22:24 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Took 0.58 seconds to deallocate network for instance.
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:24 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Deleted allocations for instance f522c0be-7d51-421c-8d6c-d01ce6f6eb26
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f26d8990-13a9-47c4-815c-2653a58dcc5d tempest-TestStampPattern-1517924890 tempest-TestStampPattern-1517924890-project-member] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-vif-unplugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] No waiting events found dispatching network-vif-unplugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:22:24 user nova-compute[71269]: WARNING nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received unexpected event network-vif-unplugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance with vm_state deleted and task_state None.
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Acquiring lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] Lock "f522c0be-7d51-421c-8d6c-d01ce6f6eb26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] No waiting events found dispatching network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:22:24 user nova-compute[71269]: WARNING nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received unexpected event network-vif-plugged-319f1294-7d2b-4725-8ecd-a21ef3df06e8 for instance with vm_state deleted and task_state None.
Apr 13 23:22:24 user nova-compute[71269]: DEBUG nova.compute.manager [req-146aa05a-c5a8-4cd6-b542-1ac25efcb094 req-9723b6ac-87cf-4dff-8fe6-c56438ded154 service nova] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Received event network-vif-deleted-319f1294-7d2b-4725-8ecd-a21ef3df06e8 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'pci_requests' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'numa_topology' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:22:26 user nova-compute[71269]: INFO nova.compute.claims [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Claim successful on node user
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:26 user nova-compute[71269]: INFO nova.network.neutron [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating port 60b18b3d-d206-49a4-81e4-f29a1b538a3c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:22:26 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing instance network info cache due to event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.network.neutron [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:22:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Creating image(s)
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Ensure instance console log exists: /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start _get_guest_xml network_info=[{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3f1685e4-4b5e-49d3-87a6-aad0e6f9a965', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04eb8a55-c6d2-4a80-a818-060635d757a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'serial': 'b88ed41a-5418-4d62-a2fa-2a20ebb28d61'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:22:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:22:27 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:22:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:22:27 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:22:27 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b7ac6a-0b83-4abd-9f0a-9bfb971635a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:22:27 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d87134-82de-417c-bdb9-dad57a542652]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61] added
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e0eab-fa33-49b1-9c1d-dc5c987d9e9c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe6979-0e41-41ff-ad3f-dd8939ebed79]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfWpzODL {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfWpzODL" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b62c8f-dff0-4d2f-9888-3ff2125c63a3]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfWpzODL'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681e5f7-6f45-4307-898d-1106884c3172]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da9934-5393-4e86-bef0-415b0c17c3f1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d856008-1be1-406e-a525-9bb786d07bab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]
Apr 13 23:22:27 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c26c6a-49bd-4ae2-8b9c-c84bed857467]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9e37b-888f-4d3a-b3fa-9025e2d78bc2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:22:27 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0632d6d9-2463-438c-b2ed-e04e0ebb2a65]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updated VIF entry in instance network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG nova.network.neutron [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:22:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-44469045-66a8-4797-bf4c-c1ee6669e2bb req-2f7c19b5-7b0b-4693-807f-e4dc30528b5a service nova] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23331313631353363', 'path': '/dev/sdc'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331313631353363', 'path': '/dev/sdc'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1980593566',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:22:21Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.objects.instance [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'pci_devices' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:22:28 user nova-compute[71269]:   <uuid>04eb8a55-c6d2-4a80-a818-060635d757a6</uuid>
Apr 13 23:22:28 user nova-compute[71269]:   <name>instance-0000002c</name>
Apr 13 23:22:28 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:22:28 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:22:28 user nova-compute[71269]:   <metadata>
Apr 13 23:22:28 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:22:28 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:22:28 user nova-compute[71269]:       <nova:name>tempest-TestShelveInstance-server-93864092</nova:name>
Apr 13 23:22:28 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:22:27</nova:creationTime>
Apr 13 23:22:28 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:22:28 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:22:28 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:22:28 user nova-compute[71269]:       <nova:owner>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:user uuid="271839d0073b49689368301d420c588a">tempest-TestShelveInstance-1015090248-project-member</nova:user>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:project uuid="405da8dd69654b3fb74203d0b7e26ad2">tempest-TestShelveInstance-1015090248</nova:project>
Apr 13 23:22:28 user nova-compute[71269]:       </nova:owner>
Apr 13 23:22:28 user nova-compute[71269]:       <nova:ports>
Apr 13 23:22:28 user nova-compute[71269]:         <nova:port uuid="60b18b3d-d206-49a4-81e4-f29a1b538a3c">
Apr 13 23:22:28 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 23:22:28 user nova-compute[71269]:         </nova:port>
Apr 13 23:22:28 user nova-compute[71269]:       </nova:ports>
Apr 13 23:22:28 user nova-compute[71269]:     </nova:instance>
Apr 13 23:22:28 user nova-compute[71269]:   </metadata>
Apr 13 23:22:28 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:22:28 user nova-compute[71269]:     <system>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="serial">04eb8a55-c6d2-4a80-a818-060635d757a6</entry>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="uuid">04eb8a55-c6d2-4a80-a818-060635d757a6</entry>
Apr 13 23:22:28 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:22:28 user nova-compute[71269]:     </system>
Apr 13 23:22:28 user nova-compute[71269]:   </sysinfo>
Apr 13 23:22:28 user nova-compute[71269]:   <os>
Apr 13 23:22:28 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:22:28 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:22:28 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:22:28 user nova-compute[71269]:   </os>
Apr 13 23:22:28 user nova-compute[71269]:   <features>
Apr 13 23:22:28 user nova-compute[71269]:     <acpi/>
Apr 13 23:22:28 user nova-compute[71269]:     <apic/>
Apr 13 23:22:28 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:22:28 user nova-compute[71269]:   </features>
Apr 13 23:22:28 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:22:28 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:22:28 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:22:28 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:22:28 user nova-compute[71269]:   </clock>
Apr 13 23:22:28 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:22:28 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:22:28 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:22:28 user nova-compute[71269]:   </cpu>
Apr 13 23:22:28 user nova-compute[71269]:   <devices>
Apr 13 23:22:28 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:22:28 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:22:28 user nova-compute[71269]:       <source dev="/dev/sdc"/>
Apr 13 23:22:28 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:22:28 user nova-compute[71269]:       <serial>b88ed41a-5418-4d62-a2fa-2a20ebb28d61</serial>
Apr 13 23:22:28 user nova-compute[71269]:     </disk>
Apr 13 23:22:28 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:22:28 user nova-compute[71269]:       <mac address="fa:16:3e:84:ae:97"/>
Apr 13 23:22:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:22:28 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:22:28 user nova-compute[71269]:       <target dev="tap60b18b3d-d2"/>
Apr 13 23:22:28 user nova-compute[71269]:     </interface>
Apr 13 23:22:28 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:22:28 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6/console.log" append="off"/>
Apr 13 23:22:28 user nova-compute[71269]:     </serial>
Apr 13 23:22:28 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:22:28 user nova-compute[71269]:     <video>
Apr 13 23:22:28 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:22:28 user nova-compute[71269]:     </video>
Apr 13 23:22:28 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:22:28 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:22:28 user nova-compute[71269]:     </rng>
Apr 13 23:22:28 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:22:28 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:22:28 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:22:28 user nova-compute[71269]:     </memballoon>
Apr 13 23:22:28 user nova-compute[71269]:   </devices>
Apr 13 23:22:28 user nova-compute[71269]: </domain>
Apr 13 23:22:28 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1980593566',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:22:21Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG os_vif [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60b18b3d-d2, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60b18b3d-d2, col_values=(('external_ids', {'iface-id': '60b18b3d-d206-49a4-81e4-f29a1b538a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ae:97', 'vm-uuid': '04eb8a55-c6d2-4a80-a818-060635d757a6'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:28 user nova-compute[71269]: INFO os_vif [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2')
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:22:28 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] No VIF found with MAC fa:16:3e:84:ae:97, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:22:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:22:30 user nova-compute[71269]: WARNING nova.compute.manager [req-6e5f28a5-9585-425d-8524-988be4b66e88 req-83410bc8-9572-481c-bc8d-dd2f21c4e0b2 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428152.3389482, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:22:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Resumed (Lifecycle Event)
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:22:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance spawned successfully.
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:22:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428152.3404148, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:22:32 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Started (Lifecycle Event)
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-36a6c48e-e351-47d6-920c-022175adca7f tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.136s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:32 user nova-compute[71269]: DEBUG nova.compute.manager [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:22:32 user nova-compute[71269]: WARNING nova.compute.manager [req-32403627-01b6-4c99-bf12-1d7fef1f575f req-3d8c4320-f3d1-4a1d-9afa-19b0afcecc33 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state active and task_state None.
Apr 13 23:22:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:38 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428143.8369935, f522c0be-7d51-421c-8d6c-d01ce6f6eb26 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:22:38 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] VM Stopped (Lifecycle Event)
Apr 13 23:22:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-c0f8540e-3ee0-487d-ab9e-f9f69f0cb9f1 None None] [instance: f522c0be-7d51-421c-8d6c-d01ce6f6eb26] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:22:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:22:43 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:22:48 user nova-compute[71269]: INFO nova.compute.manager [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Detaching volume f353a28d-41ad-4994-b1ad-c46d03702c33
Apr 13 23:22:48 user nova-compute[71269]: INFO nova.virt.block_device [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Attempting to driver detach volume f353a28d-41ad-4994-b1ad-c46d03702c33 from mountpoint /dev/vdc
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Attempting to detach device vdc from instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 from the persistent domain config. {{(pid=71269) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:22:48 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:22:48 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:22:48 user nova-compute[71269]:   <target dev="vdc" bus="virtio"/>
Apr 13 23:22:48 user nova-compute[71269]:   <serial>f353a28d-41ad-4994-b1ad-c46d03702c33</serial>
Apr 13 23:22:48 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:22:48 user nova-compute[71269]: </disk>
Apr 13 23:22:48 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:22:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully detached device vdc from instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 from the persistent domain config.
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 from the live domain config. {{(pid=71269) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 23:22:48 user nova-compute[71269]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:22:48 user nova-compute[71269]:   <source dev="/dev/sdb"/>
Apr 13 23:22:48 user nova-compute[71269]:   <target dev="vdc" bus="virtio"/>
Apr 13 23:22:48 user nova-compute[71269]:   <serial>f353a28d-41ad-4994-b1ad-c46d03702c33</serial>
Apr 13 23:22:48 user nova-compute[71269]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 23:22:48 user nova-compute[71269]: </disk>
Apr 13 23:22:48 user nova-compute[71269]:  {{(pid=71269) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Received event <DeviceRemovedEvent: 1681428168.9627736, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71269) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 23:22:48 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully detached device vdc from instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 from the live domain config.
Apr 13 23:22:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'febryjAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:22:48 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55e336f-7875-4c28-97a0-da46b3e0fe68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:22:48 user nova-compute[71269]: No targets found.
Apr 13 23:22:48 user nova-compute[71269]: iSNS:
Apr 13 23:22:48 user nova-compute[71269]: No targets found.
Apr 13 23:22:48 user nova-compute[71269]: STATIC:
Apr 13 23:22:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61
Apr 13 23:22:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:22:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:22:48 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33
Apr 13 23:22:48 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:22:48 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:22:48 user nova-compute[71269]: FIRMWARE:
Apr 13 23:22:48 user nova-compute[71269]: No targets found.
Apr 13 23:22:48 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:22:48 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:22:48 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:22:48 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac14112-8138-47e0-9114-4f1754e9d5fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[756af920-7a3f-47a3-b7e3-abb9f3ccff24]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:49 user nova-compute[71269]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:22:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 (non-flash)
Apr 13 23:22:49 user nova-compute[71269]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:22:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3bc2b79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6667cdc5-0716-46ee-bdfd-d0c0a6d02190]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[144afa94-c0e0-47c0-b7f1-5932b5c27ddb]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e271c-bc88-4732-827a-01dcabcb3532]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a9bd84-69bd-465d-b2b6-4b580dbdcbd4]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f616f5a-8ecf-40be-92d0-557e831acb64]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[72318be8-ca68-445b-aa21-faf2f5c58646]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260]
Apr 13 23:22:49 user nova-compute[71269]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33, portal: 172.16.0.220,3260] successful.
Apr 13 23:22:49 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f353a28d-41ad-4994-b1ad-c46d03702c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b4611-2eff-4c58-94a5-fb4aebc45293]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] <== disconnect_volume: return (297ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:22:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:50 user nova-compute[71269]: DEBUG nova.objects.instance [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'flavor' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:22:50 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-3f02a81f-6925-461d-9c88-112b9cd1eb4a tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:22:53 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:58 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:22:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:05 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:05 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:23:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:09 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:23:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:23:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8466MB free_disk=26.207759857177734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:23:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:23:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:23:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:23:13 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:17 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:18 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:23:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:23 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:28 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:33 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing instance network info cache due to event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated VIF entry in instance network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG nova.network.neutron [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:23:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-b70e235e-43ae-4515-a553-3c784d531eba req-b7c786b2-b14d-4474-9254-7c0156858029 service nova] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:23:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:37 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:23:38 user nova-compute[71269]: INFO nova.compute.claims [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Claim successful on node user
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:23:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:23:38 user nova-compute[71269]: INFO nova.virt.block_device [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Booting with volume 78d07dc5-246c-4db0-a870-2beebf4310a9 at /dev/vda
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.policy [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59b2c11a23384f678a086de89139497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68330047a5fd4e4397cf5edca18c5b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.utils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5721dbe-23a7-48a0-b27f-93ddb2fa7b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a320630-f5cb-4bc4-94fd-c6844883671e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c1c66-afbd-44f6-a7b2-4e6e6d6cd753]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f21e4-e937-47bb-8906-78b3bc4fae36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:38 user nova-compute[71269]: INFO nova.compute.manager [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Terminating instance
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:23:38 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:23:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d1d8c-e3f6-42c1-b687-13a0eca41a38]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG os_brick.utils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.virt.block_device [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating existing volume attachment record: 376e3f4b-ff30-45b5-8a26-df8ca3d5a8dd {{(pid=71269) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:38 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.compute.manager [req-78ce245e-864c-4eed-b72f-8232ad5cf548 req-ea08b3b2-6119-44c0-89cc-0243af7c50a4 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-unplugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Successfully created port: 32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Instance destroyed successfully.
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.objects.instance [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'resources' on Instance uuid 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-567976838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-567976838',id=42,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRHhnAKdZFUW2qGL3xJyfalvtnzUb12fQWEKaj1zVCyg5qFeLmoWDgWt5B/CDTEZ5VNMSCnig9fSEEvVhciP/p+fUw6A9lTrWimhc/xwqS7liP8+sW9m/AzIzM0EZ7OOg==',key_name='tempest-keypair-106580173',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-huzypxkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "b3a3698d-6a99-43ff-8298-a59026248b01", "address": "fa:16:3e:45:1b:fe", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a3698d-6a", "ovs_interfaceid": "b3a3698d-6a99-43ff-8298-a59026248b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG os_vif [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3a3698d-6a, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:23:39 user nova-compute[71269]: INFO os_vif [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1b:fe,bridge_name='br-int',has_traffic_filtering=True,id=b3a3698d-6a99-43ff-8298-a59026248b01,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a3698d-6a')
Apr 13 23:23:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Deleting instance files /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55_del
Apr 13 23:23:39 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Deletion of /opt/stack/data/nova/instances/7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55_del complete
Apr 13 23:23:39 user nova-compute[71269]: INFO nova.compute.manager [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 23:23:39 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:23:39 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Successfully updated port: 32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-changed-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.compute.manager [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Refreshing instance network info cache due to event network-changed-32c825d8-b7d0-42c1-b8bd-49b1d35821f9. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:23:40 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Took 1.28 seconds to deallocate network for instance.
Apr 13 23:23:40 user nova-compute[71269]: DEBUG nova.network.neutron [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance network_info: |[{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.network.neutron [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Refreshing network info cache for port 32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Acquiring lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] No waiting events found dispatching network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:23:41 user nova-compute[71269]: WARNING nova.compute.manager [req-bdf9b512-d91a-4fa5-bb38-7b0b5a2cd037 req-39c565f8-b0c9-4e76-87be-5ba4f2493aaf service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received unexpected event network-vif-plugged-b3a3698d-6a99-43ff-8298-a59026248b01 for instance with vm_state deleted and task_state None.
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:41 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Deleted allocations for instance 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-f0ed6321-e058-4f6a-b6f8-8128524114db tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.574s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.network.neutron [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updated VIF entry in instance network info cache for port 32c825d8-b7d0-42c1-b8bd-49b1d35821f9. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG nova.network.neutron [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:23:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-75eaa6d0-facc-4986-a3e6-4e3bb400ebba req-768a0ec0-d8dd-4f8b-97f6-5cd09a5c2ca5 service nova] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:23:42 user nova-compute[71269]: DEBUG nova.compute.manager [req-5d69e543-6ac8-4a31-849c-4b5c6cce744e req-f2596a5f-3a50-4595-9693-9f7121123217 service nova] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Received event network-vif-deleted-b3a3698d-6a99-43ff-8298-a59026248b01 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:23:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Creating image(s)
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start _get_guest_xml network_info=[{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '376e3f4b-ff30-45b5-8a26-df8ca3d5a8dd', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04', 'attached_at': '', 'detached_at': '', 'volume_id': '78d07dc5-246c-4db0-a870-2beebf4310a9', 'serial': '78d07dc5-246c-4db0-a870-2beebf4310a9'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:23:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:23:43 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:23:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:23:43 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:23:43 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf6966-ce88-487a-a0c0-df45c0ecd890]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:23:43 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34215c2-ddfa-4907-9fb0-6d3f9397561b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9] added
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9998de-59a0-4baa-8f18-7311e3d0f645]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325a42c-d45e-4f84-9d28-220d07ac8d68]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIspgyBH {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIspgyBH" returned: 0 in 0.085s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa3114-939a-475c-86ed-764878f34f46]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIspgyBH'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2888e44-f3a4-43b8-8762-b6bf462132ae]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[139168e8-a73a-461e-b7ae-f91336ffc1d4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d3a36-e978-4225-be2a-7c62a97367cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]
Apr 13 23:23:43 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26af24d-0654-4577-8f13-499d0dc6cd1c]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3705920b-6c36-4f2c-92a6-853358720194]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:23:43 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c34b2e5-6031-4e9b-99db-73f7668ccba9]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:23:43 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23534303364623063', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534303364623063', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.objects.instance [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:23:44 user nova-compute[71269]:   <uuid>0ba1c8fe-0485-4d72-b82a-354c2b21ce04</uuid>
Apr 13 23:23:44 user nova-compute[71269]:   <name>instance-0000002e</name>
Apr 13 23:23:44 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:23:44 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:23:44 user nova-compute[71269]:   <metadata>
Apr 13 23:23:44 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:23:44 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:23:44 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-1208753564</nova:name>
Apr 13 23:23:44 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:23:43</nova:creationTime>
Apr 13 23:23:44 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:23:44 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:23:44 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:23:44 user nova-compute[71269]:       <nova:owner>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:23:44 user nova-compute[71269]:       </nova:owner>
Apr 13 23:23:44 user nova-compute[71269]:       <nova:ports>
Apr 13 23:23:44 user nova-compute[71269]:         <nova:port uuid="32c825d8-b7d0-42c1-b8bd-49b1d35821f9">
Apr 13 23:23:44 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:23:44 user nova-compute[71269]:         </nova:port>
Apr 13 23:23:44 user nova-compute[71269]:       </nova:ports>
Apr 13 23:23:44 user nova-compute[71269]:     </nova:instance>
Apr 13 23:23:44 user nova-compute[71269]:   </metadata>
Apr 13 23:23:44 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:23:44 user nova-compute[71269]:     <system>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="serial">0ba1c8fe-0485-4d72-b82a-354c2b21ce04</entry>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="uuid">0ba1c8fe-0485-4d72-b82a-354c2b21ce04</entry>
Apr 13 23:23:44 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:23:44 user nova-compute[71269]:     </system>
Apr 13 23:23:44 user nova-compute[71269]:   </sysinfo>
Apr 13 23:23:44 user nova-compute[71269]:   <os>
Apr 13 23:23:44 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:23:44 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:23:44 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:23:44 user nova-compute[71269]:   </os>
Apr 13 23:23:44 user nova-compute[71269]:   <features>
Apr 13 23:23:44 user nova-compute[71269]:     <acpi/>
Apr 13 23:23:44 user nova-compute[71269]:     <apic/>
Apr 13 23:23:44 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:23:44 user nova-compute[71269]:   </features>
Apr 13 23:23:44 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:23:44 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:23:44 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:23:44 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:23:44 user nova-compute[71269]:   </clock>
Apr 13 23:23:44 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:23:44 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:23:44 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:23:44 user nova-compute[71269]:   </cpu>
Apr 13 23:23:44 user nova-compute[71269]:   <devices>
Apr 13 23:23:44 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:23:44 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:23:44 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:23:44 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:23:44 user nova-compute[71269]:       <serial>78d07dc5-246c-4db0-a870-2beebf4310a9</serial>
Apr 13 23:23:44 user nova-compute[71269]:     </disk>
Apr 13 23:23:44 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:23:44 user nova-compute[71269]:       <mac address="fa:16:3e:81:c4:d9"/>
Apr 13 23:23:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:23:44 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:23:44 user nova-compute[71269]:       <target dev="tap32c825d8-b7"/>
Apr 13 23:23:44 user nova-compute[71269]:     </interface>
Apr 13 23:23:44 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:23:44 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/console.log" append="off"/>
Apr 13 23:23:44 user nova-compute[71269]:     </serial>
Apr 13 23:23:44 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:23:44 user nova-compute[71269]:     <video>
Apr 13 23:23:44 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:23:44 user nova-compute[71269]:     </video>
Apr 13 23:23:44 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:23:44 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:23:44 user nova-compute[71269]:     </rng>
Apr 13 23:23:44 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:23:44 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:23:44 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:23:44 user nova-compute[71269]:     </memballoon>
Apr 13 23:23:44 user nova-compute[71269]:   </devices>
Apr 13 23:23:44 user nova-compute[71269]: </domain>
Apr 13 23:23:44 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG os_vif [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c825d8-b7, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c825d8-b7, col_values=(('external_ids', {'iface-id': '32c825d8-b7d0-42c1-b8bd-49b1d35821f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:c4:d9', 'vm-uuid': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:44 user nova-compute[71269]: INFO os_vif [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7')
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:23:44 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:81:c4:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:23:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:46 user nova-compute[71269]: DEBUG nova.compute.manager [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:23:46 user nova-compute[71269]: WARNING nova.compute.manager [req-d814676d-d89d-40cc-be07-30811a9fbf6d req-d7c0f2ae-3033-4ddc-98a1-962200c2de28 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state building and task_state spawning.
Apr 13 23:23:47 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428227.9903588, 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:23:47 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] VM Resumed (Lifecycle Event)
Apr 13 23:23:47 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:23:47 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:23:47 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance spawned successfully.
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:23:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428227.9943, 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:23:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] VM Started (Lifecycle Event)
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:23:48 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:23:48 user nova-compute[71269]: INFO nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Took 4.93 seconds to spawn the instance on the hypervisor.
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:23:48 user nova-compute[71269]: INFO nova.compute.manager [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Took 10.12 seconds to build instance.
Apr 13 23:23:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-d1a3333b-7e14-495d-ab79-0ed559e958bb tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.207s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:23:48 user nova-compute[71269]: DEBUG nova.compute.manager [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:23:48 user nova-compute[71269]: WARNING nova.compute.manager [req-744452d7-73bb-4c38-b255-bf8259c3c893 req-f8bd68f8-b839-4389-9a36-f3da67bdcb1c service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state None.
Apr 13 23:23:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:54 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428219.5160723, 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:23:54 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] VM Stopped (Lifecycle Event)
Apr 13 23:23:54 user nova-compute[71269]: DEBUG nova.compute.manager [None req-4cb59f2e-a089-4050-bc7e-e836c1de9f72 None None] [instance: 7ac78bb7-9e9e-4a35-a1f4-874d6a93fd55] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:23:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:23:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:00 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:24:00 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:24:01 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:09 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:24:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:24:10 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=26.22482681274414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:24:10 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing instance network info cache due to event network-changed-60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Acquiring lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Acquired lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:24:11 user nova-compute[71269]: DEBUG nova.network.neutron [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Refreshing network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Skipping network cache update for instance because it is being deleted. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:12 user nova-compute[71269]: INFO nova.compute.manager [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Terminating instance
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.network.neutron [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updated VIF entry in instance network info cache for port 60b18b3d-d206-49a4-81e4-f29a1b538a3c. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.network.neutron [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [{"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ce2abc04-73bc-4f0c-9a11-873e61462c7f req-4fa4bdaa-cdd3-496d-aa97-fcc5a141ebfe service nova] Releasing lock "refresh_cache-04eb8a55-c6d2-4a80-a818-060635d757a6" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:24:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Instance destroyed successfully.
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lazy-loading 'resources' on Instance uuid 04eb8a55-c6d2-4a80-a818-060635d757a6 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:18:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-93864092',display_name='tempest-TestShelveInstance-server-93864092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-93864092',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvcgABwMirIcE19N+aazLx0Zg51+obS69YGRl6d0PeLCmslra6FLm+QyggrY60hO14lhcjk64wNOa7203g364QXdlHw2OjXK932WJyS+1PEJhGR3jaPzH4rq5v9Sj3ICQ==',key_name='tempest-TestShelveInstance-1980593566',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:22:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405da8dd69654b3fb74203d0b7e26ad2',ramdisk_id='',reservation_id='r-q221w3yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1015090248',owner_user_name='tempest-TestShelveInstance-1015090248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:22:32Z,user_data=None,user_id='271839d0073b49689368301d420c588a',uuid=04eb8a55-c6d2-4a80-a818-060635d757a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converting VIF {"id": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "address": "fa:16:3e:84:ae:97", "network": {"id": "8a45c5ee-8ca2-4056-becb-8c2011efdf1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1440453273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405da8dd69654b3fb74203d0b7e26ad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b18b3d-d2", "ovs_interfaceid": "60b18b3d-d206-49a4-81e4-f29a1b538a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_vif [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b18b3d-d2, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:12 user nova-compute[71269]: INFO os_vif [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ae:97,bridge_name='br-int',has_traffic_filtering=True,id=60b18b3d-d206-49a4-81e4-f29a1b538a3c,network=Network(8a45c5ee-8ca2-4056-becb-8c2011efdf1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b18b3d-d2')
Apr 13 23:24:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfWpzODL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:24:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae4ffb-5406-4ea2-92bf-1e61109520c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:24:12 user nova-compute[71269]: No targets found.
Apr 13 23:24:12 user nova-compute[71269]: iSNS:
Apr 13 23:24:12 user nova-compute[71269]: No targets found.
Apr 13 23:24:12 user nova-compute[71269]: STATIC:
Apr 13 23:24:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61
Apr 13 23:24:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:24:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:24:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9
Apr 13 23:24:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:24:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:24:12 user nova-compute[71269]: FIRMWARE:
Apr 13 23:24:12 user nova-compute[71269]: No targets found.
Apr 13 23:24:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:24:12 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:24:12 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d956c341-f098-414a-b29d-4ff5037b6f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72a451-a9ea-4fdf-b474-81019dd467c6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:24:12 user nova-compute[71269]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:24:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 (non-flash)
Apr 13 23:24:12 user nova-compute[71269]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:24:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c18ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61'): ({'sdc'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Removing single pathed devices sdc {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa231a8-5dfd-4090-b435-e0bbeca29bd8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[040118cf-8bac-4619-a40a-9f6d3933f7a9]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Flushing IO for device /dev/sdc {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049642b-8c10-429d-824e-79e37dbff60e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[747f2249-6924-4492-87a3-e661865e0ce2]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] SCSI volumes sdc have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ecc5fde1',) {{(pid=81834) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b58cee-2a22-4a16-accf-a5e4199f5912]: (4, None) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8a3f1-2b6f-445d-9632-b230dc687fe6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ad6de-c4e1-48b6-a2ec-8933be2fed57]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260]
Apr 13 23:24:13 user nova-compute[71269]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61, portal: 172.16.0.220,3260] successful.
Apr 13 23:24:13 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b88ed41a-5418-4d62-a2fa-2a20ebb28d61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5e228-3837-4486-93c6-639f41dd1236]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] <== disconnect_volume: return (313ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:24:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deleting instance files /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6_del
Apr 13 23:24:13 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deletion of /opt/stack/data/nova/instances/04eb8a55-c6d2-4a80-a818-060635d757a6_del complete
Apr 13 23:24:13 user nova-compute[71269]: INFO nova.compute.manager [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 13 23:24:13 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-deleted-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:13 user nova-compute[71269]: INFO nova.compute.manager [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Neutron deleted interface 60b18b3d-d206-49a4-81e4-f29a1b538a3c; detaching it from the instance and deleting it from the info cache
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.network.neutron [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:24:13 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Took 0.43 seconds to deallocate network for instance.
Apr 13 23:24:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-0b5a4728-9bc0-45c5-969f-9c6383753e6a req-5c25a982-1806-4bcd-9568-b8ed6c8c1e6f service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Detach interface failed, port_id=60b18b3d-d206-49a4-81e4-f29a1b538a3c, reason: Instance 04eb8a55-c6d2-4a80-a818-060635d757a6 could not be found. {{(pid=71269) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-unplugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Acquiring lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] No waiting events found dispatching network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:24:14 user nova-compute[71269]: WARNING nova.compute.manager [req-3123770c-01a0-49b4-a27d-aea12a4947ce req-c11a7b35-1495-4197-b9f1-b5a5ef0f7cd6 service nova] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Received unexpected event network-vif-plugged-60b18b3d-d206-49a4-81e4-f29a1b538a3c for instance with vm_state active and task_state deleting.
Apr 13 23:24:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:14 user nova-compute[71269]: INFO nova.compute.manager [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Deleting volume: b88ed41a-5418-4d62-a2fa-2a20ebb28d61 {{(pid=71269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:14 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Deleted allocations for instance 04eb8a55-c6d2-4a80-a818-060635d757a6
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-575b2ad0-3dc7-4d53-8add-10b5b9a9e43e tempest-TestShelveInstance-1015090248 tempest-TestShelveInstance-1015090248-project-member] Lock "04eb8a55-c6d2-4a80-a818-060635d757a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.765s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:16 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:24:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:17 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:24:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428252.8366199, 04eb8a55-c6d2-4a80-a818-060635d757a6 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:24:27 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] VM Stopped (Lifecycle Event)
Apr 13 23:24:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-de69bc6c-e82c-4c89-9d56-34e4c444cc27 None None] [instance: 04eb8a55-c6d2-4a80-a818-060635d757a6] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:24:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Starting instance... {{(pid=71269) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:32 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:24:32 user nova-compute[71269]: INFO nova.compute.claims [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Claim successful on node user
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start building networks asynchronously for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Allocating IP information in the background. {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] allocate_for_instance() {{(pid=71269) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 23:24:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start building block device mappings for instance. {{(pid=71269) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.policy [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e66f624501c3404bb1eb9412a8a6c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ad0d0e72ad43cca506267d62269910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71269) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start spawning the instance on the hypervisor. {{(pid=71269) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:24:33 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Creating image(s)
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f,backing_fmt=raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk 1073741824" returned: 0 in 0.057s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "649f6a896c807bc1a36cb3d587aeca2ec6274c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk. size=1073741824 {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 23:24:33 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.virt.disk.api [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Cannot resize image /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk to a smaller size. {{(pid=71269) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.objects.instance [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'migration_context' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Ensure instance console log exists: /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Successfully created port: 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Successfully updated port: 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.compute.manager [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing instance network info cache due to event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:24:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance cache missing network info. {{(pid=71269) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.neutron [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance network_info: |[{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71269) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start _get_guest_xml network_info=[{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:24:35 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:24:35 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T22:49:06Z,direct_url=<?>,disk_format='qcow2',id=d6970ace-53c3-48ed-ae08-e4c3846a312a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='6ae05bac4793407ea3c17cd2e4fb8b5c',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T22:49:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvYa/qbohXL8t77LIIOS/oHQFIJOy9DvFTUSwa5laQz6hTF++BR/SJDTRnkzuy3ekPDiP1NzkwecHGwm8X+Lr9Sv3GYLMebgTDhY9CiZp0mH5fK3XDLzfE8aE5qXvlzaA==',key_name='tempest-keypair-1255905063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.objects.instance [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_devices' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:24:35 user nova-compute[71269]:   <uuid>f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</uuid>
Apr 13 23:24:35 user nova-compute[71269]:   <name>instance-0000002f</name>
Apr 13 23:24:35 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:24:35 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:24:35 user nova-compute[71269]:   <metadata>
Apr 13 23:24:35 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:24:35 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-275106454</nova:name>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:24:35</nova:creationTime>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:24:35 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:24:35 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:owner>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:user uuid="e66f624501c3404bb1eb9412a8a6c951">tempest-AttachVolumeShelveTestJSON-953327095-project-member</nova:user>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:project uuid="b9ad0d0e72ad43cca506267d62269910">tempest-AttachVolumeShelveTestJSON-953327095</nova:project>
Apr 13 23:24:35 user nova-compute[71269]:       </nova:owner>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:root type="image" uuid="d6970ace-53c3-48ed-ae08-e4c3846a312a"/>
Apr 13 23:24:35 user nova-compute[71269]:       <nova:ports>
Apr 13 23:24:35 user nova-compute[71269]:         <nova:port uuid="35f2f7df-8994-44fe-af00-26d1a8f24c83">
Apr 13 23:24:35 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 23:24:35 user nova-compute[71269]:         </nova:port>
Apr 13 23:24:35 user nova-compute[71269]:       </nova:ports>
Apr 13 23:24:35 user nova-compute[71269]:     </nova:instance>
Apr 13 23:24:35 user nova-compute[71269]:   </metadata>
Apr 13 23:24:35 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:24:35 user nova-compute[71269]:     <system>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="serial">f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</entry>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="uuid">f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</entry>
Apr 13 23:24:35 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:24:35 user nova-compute[71269]:     </system>
Apr 13 23:24:35 user nova-compute[71269]:   </sysinfo>
Apr 13 23:24:35 user nova-compute[71269]:   <os>
Apr 13 23:24:35 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:24:35 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:24:35 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:24:35 user nova-compute[71269]:   </os>
Apr 13 23:24:35 user nova-compute[71269]:   <features>
Apr 13 23:24:35 user nova-compute[71269]:     <acpi/>
Apr 13 23:24:35 user nova-compute[71269]:     <apic/>
Apr 13 23:24:35 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:24:35 user nova-compute[71269]:   </features>
Apr 13 23:24:35 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:24:35 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:24:35 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:24:35 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:24:35 user nova-compute[71269]:   </clock>
Apr 13 23:24:35 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:24:35 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:24:35 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:24:35 user nova-compute[71269]:   </cpu>
Apr 13 23:24:35 user nova-compute[71269]:   <devices>
Apr 13 23:24:35 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:24:35 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:24:35 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk"/>
Apr 13 23:24:35 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:24:35 user nova-compute[71269]:     </disk>
Apr 13 23:24:35 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:24:35 user nova-compute[71269]:       <mac address="fa:16:3e:26:43:06"/>
Apr 13 23:24:35 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:24:35 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:24:35 user nova-compute[71269]:       <target dev="tap35f2f7df-89"/>
Apr 13 23:24:35 user nova-compute[71269]:     </interface>
Apr 13 23:24:35 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:24:35 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/console.log" append="off"/>
Apr 13 23:24:35 user nova-compute[71269]:     </serial>
Apr 13 23:24:35 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:24:35 user nova-compute[71269]:     <video>
Apr 13 23:24:35 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:24:35 user nova-compute[71269]:     </video>
Apr 13 23:24:35 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:24:35 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:24:35 user nova-compute[71269]:     </rng>
Apr 13 23:24:35 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:24:35 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:24:35 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:24:35 user nova-compute[71269]:     </memballoon>
Apr 13 23:24:35 user nova-compute[71269]:   </devices>
Apr 13 23:24:35 user nova-compute[71269]: </domain>
Apr 13 23:24:35 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvYa/qbohXL8t77LIIOS/oHQFIJOy9DvFTUSwa5laQz6hTF++BR/SJDTRnkzuy3ekPDiP1NzkwecHGwm8X+Lr9Sv3GYLMebgTDhY9CiZp0mH5fK3XDLzfE8aE5qXvlzaA==',key_name='tempest-keypair-1255905063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG os_vif [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35f2f7df-89, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35f2f7df-89, col_values=(('external_ids', {'iface-id': '35f2f7df-8994-44fe-af00-26d1a8f24c83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:43:06', 'vm-uuid': 'f06f6eff-76a8-4c0a-9e11-b49b0c09e22a'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:35 user nova-compute[71269]: INFO os_vif [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89')
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No VIF found with MAC fa:16:3e:26:43:06, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updated VIF entry in instance network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG nova.network.neutron [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:24:35 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-6e55a783-01cd-4d59-9546-41107d84405c req-1d649fd4-7e27-410b-94ab-40975064df71 service nova] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:36 user nova-compute[71269]: DEBUG nova.compute.manager [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:24:36 user nova-compute[71269]: WARNING nova.compute.manager [req-53b4cb96-3f21-48b7-8cd2-16d769c9bae8 req-823db6cc-068e-472c-adea-4e928fa8c98d service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state building and task_state spawning.
Apr 13 23:24:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428278.719474, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Resumed (Lifecycle Event)
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance spawned successfully.
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_cdrom_bus of ide {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_disk_bus of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_input_bus of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_pointer_model of None {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_video_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Found default for hw_vif_model of virtio {{(pid=71269) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428278.7205813, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Started (Lifecycle Event)
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Took 5.37 seconds to spawn the instance on the hypervisor.
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:24:38 user nova-compute[71269]: INFO nova.compute.manager [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Took 6.07 seconds to build instance.
Apr 13 23:24:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-97740376-c653-4e7e-9ed9-55f42ea83996 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.167s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:24:38 user nova-compute[71269]: DEBUG nova.compute.manager [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:24:38 user nova-compute[71269]: WARNING nova.compute.manager [req-2d31b211-9739-4b76-bcef-666683076f77 req-48984d2c-843e-4413-b295-4dc59022300a service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state active and task_state None.
Apr 13 23:24:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:24:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:24:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:07 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:25:08 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:11 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:25:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8568MB free_disk=26.202503204345703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:25:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:25:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:25:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:25:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:25:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:25:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:25:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:17 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:18 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:18 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:25:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing instance network info cache due to event network-changed-1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Refreshing network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated VIF entry in instance network info cache for port 1f5d0400-132c-4746-9b98-a86dfc3511af. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG nova.network.neutron [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:25:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-5769153d-04b0-4c44-936b-b23826782a56 req-9ef38159-a2d7-4202-9edb-2848360c6adc service nova] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Stashing vm_state: active {{(pid=71269) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_requests' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:25:30 user nova-compute[71269]: INFO nova.compute.claims [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Claim successful on node user
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.objects.instance [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:25:30 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating resource usage from migration 8e591da0-2c17-4dd7-a79e-758889ca5874
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.311s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:30 user nova-compute[71269]: INFO nova.compute.manager [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Migrating
Apr 13 23:25:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:25:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-changed-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Refreshing instance network info cache due to event network-changed-32c825d8-b7d0-42c1-b8bd-49b1d35821f9. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.network.neutron [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Refreshing network info cache for port 32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Starting migrate_disk_and_power_off {{(pid=71269) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:25:31 user nova-compute[71269]: WARNING nova.compute.manager [req-776543a3-6062-41c3-bc24-3d57ba0984c6 req-ce936b4e-34b9-4f92-9347-2b8478eccb2b service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state resize_migrating.
Apr 13 23:25:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updated VIF entry in instance network info cache for port 32c825d8-b7d0-42c1-b8bd-49b1d35821f9. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a36345c6-d1e6-4d3c-96d4-f7175ea40525 req-f2c6643b-6516-4e33-8b83-6f653ead9321 service nova] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:25:32 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance destroyed successfully.
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c825d8-b7, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:25:32 user nova-compute[71269]: INFO os_vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7')
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:25:32 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9461877f-3e1b-476e-b63b-337245959015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:25:32 user nova-compute[71269]: No targets found.
Apr 13 23:25:32 user nova-compute[71269]: iSNS:
Apr 13 23:25:32 user nova-compute[71269]: No targets found.
Apr 13 23:25:32 user nova-compute[71269]: STATIC:
Apr 13 23:25:32 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9
Apr 13 23:25:32 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:25:32 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:25:32 user nova-compute[71269]: FIRMWARE:
Apr 13 23:25:32 user nova-compute[71269]: No targets found.
Apr 13 23:25:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:25:32 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:25:32 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f54186-499a-468d-8122-81be8f08c7b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c64b0-5fd8-4117-8fa9-19526aabf4cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:25:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:25:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7f70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f5316-1c10-49fd-8349-8d868f0f665d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1dc8a-3c9c-48df-8aee-63383aff6c7f]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbc5fe0-d059-4005-b89f-a4a3ca6255f6]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.089s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0231d1c-e7a2-4be6-a57a-b8809af5b0aa]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab9818-f59f-4971-b671-f830a1302ffb]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9e4a9d-b5d6-4069-9baf-fad5cc618704]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]
Apr 13 23:25:32 user nova-compute[71269]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.
Apr 13 23:25:32 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894f4e5-dbc1-406d-8f55-609154a048ee]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (371ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:25:32 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Port 32c825d8-b7d0-42c1-b8bd-49b1d35821f9 binding to destination host user is already ACTIVE {{(pid=71269) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG nova.network.neutron [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:33 user nova-compute[71269]: DEBUG nova.compute.manager [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:25:33 user nova-compute[71269]: WARNING nova.compute.manager [req-97193bd9-0782-4855-bedf-d2d71ee934e5 req-f7c74864-65f4-4499-944a-e6c04ff01776 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state resize_migrated.
Apr 13 23:25:34 user nova-compute[71269]: DEBUG nova.network.neutron [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.utils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0af8e-c2a5-4f3c-9fc4-349cb54ad549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c1fcc8f88fb\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[330045c6-16f5-4d35-9bbe-1ed58f6d5404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16105f60-4406-4f08-8bb7-8d5192fbc252]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ba6e9-e20a-44f5-8e40-2e83ac013cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Running cmd (subprocess): nvme version {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] nvme not present on system {{(pid=71269) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 23:25:34 user nova-compute[71269]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 23:25:34 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20d40b-d867-43dd-afb1-3bb27504edf3]: (4, '') {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71269) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.lightos [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] LIGHTOS: no hostnqn found. {{(pid=71269) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 23:25:34 user nova-compute[71269]: DEBUG os_brick.utils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c1fcc8f88fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:25:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Starting finish_migration {{(pid=71269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance directory exists: not creating {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 23:25:38 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Creating image(s)
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Did not create local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start _get_guest_xml network_info=[{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '13874a6b-96ae-4b18-9330-1679bf2faeab', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04', 'attached_at': '2023-04-13T23:25:39.000000', 'detached_at': '', 'volume_id': '78d07dc5-246c-4db0-a870-2beebf4310a9', 'serial': '78d07dc5-246c-4db0-a870-2beebf4310a9'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:25:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:25:38 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.objects.instance [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Calling os-brick to attach iSCSI Volume {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:25:38 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:25:38 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:25:38 user nova-compute[71269]: INFO os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f9133-31ce-4ce1-9387-47bae214f380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 23:25:38 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07bd19-68df-43cc-8f8e-420af6bcff0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9] added\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9] added
Apr 13 23:25:38 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6e0b2-7a47-4437-8c85-bb5055e92051]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[81475e61-b8d6-4340-9341-6e4b26e6ca24]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIspgyBH {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIspgyBH" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd0132-c002-4bd5-a5e8-b50fb969232e]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIspgyBH'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e2c09-adbd-42e3-97f0-8c2dc785c3c5]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd4d5c-a945-4790-bb17-b209b81c896a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:25:38 user nova-compute[71269]:  {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:25:38 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 23:25:38 user nova-compute[71269]:  {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:25:38 user nova-compute[71269]: WARNING os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 23:25:38 user nova-compute[71269]: 
Apr 13 23:25:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --login {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c533c615-0a1b-4f65-b47e-16dbe835449b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]
Apr 13 23:25:39 user nova-compute[71269]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.
Apr 13 23:25:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[372bc914-c19e-4ceb-b674-abd2a747ebd7]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6470a60-033a-4ce3-a9e6-a2fb9a634bed]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:25:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:25:39 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to 172.16.0.220:3260 {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71269) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71269) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[167a2bd0-5a38-4eed-a258-1df89a140980]: (4, ('- - 0', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71269) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 23:25:39 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71269) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23534303364623063', 'path': '/dev/sdb'} {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534303364623063', 'path': '/dev/sdb'} {{(pid=71269) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:25:40 user nova-compute[71269]:   <uuid>0ba1c8fe-0485-4d72-b82a-354c2b21ce04</uuid>
Apr 13 23:25:40 user nova-compute[71269]:   <name>instance-0000002e</name>
Apr 13 23:25:40 user nova-compute[71269]:   <memory>196608</memory>
Apr 13 23:25:40 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:25:40 user nova-compute[71269]:   <metadata>
Apr 13 23:25:40 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:25:40 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:25:40 user nova-compute[71269]:       <nova:name>tempest-ServerActionsTestJSON-server-1208753564</nova:name>
Apr 13 23:25:40 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:25:38</nova:creationTime>
Apr 13 23:25:40 user nova-compute[71269]:       <nova:flavor name="m1.micro">
Apr 13 23:25:40 user nova-compute[71269]:         <nova:memory>192</nova:memory>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:25:40 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:25:40 user nova-compute[71269]:       <nova:owner>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:user uuid="59b2c11a23384f678a086de89139497d">tempest-ServerActionsTestJSON-372556233-project-member</nova:user>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:project uuid="68330047a5fd4e4397cf5edca18c5b51">tempest-ServerActionsTestJSON-372556233</nova:project>
Apr 13 23:25:40 user nova-compute[71269]:       </nova:owner>
Apr 13 23:25:40 user nova-compute[71269]:       <nova:ports>
Apr 13 23:25:40 user nova-compute[71269]:         <nova:port uuid="32c825d8-b7d0-42c1-b8bd-49b1d35821f9">
Apr 13 23:25:40 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 23:25:40 user nova-compute[71269]:         </nova:port>
Apr 13 23:25:40 user nova-compute[71269]:       </nova:ports>
Apr 13 23:25:40 user nova-compute[71269]:     </nova:instance>
Apr 13 23:25:40 user nova-compute[71269]:   </metadata>
Apr 13 23:25:40 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:25:40 user nova-compute[71269]:     <system>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="serial">0ba1c8fe-0485-4d72-b82a-354c2b21ce04</entry>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="uuid">0ba1c8fe-0485-4d72-b82a-354c2b21ce04</entry>
Apr 13 23:25:40 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:25:40 user nova-compute[71269]:     </system>
Apr 13 23:25:40 user nova-compute[71269]:   </sysinfo>
Apr 13 23:25:40 user nova-compute[71269]:   <os>
Apr 13 23:25:40 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:25:40 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:25:40 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:25:40 user nova-compute[71269]:   </os>
Apr 13 23:25:40 user nova-compute[71269]:   <features>
Apr 13 23:25:40 user nova-compute[71269]:     <acpi/>
Apr 13 23:25:40 user nova-compute[71269]:     <apic/>
Apr 13 23:25:40 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:25:40 user nova-compute[71269]:   </features>
Apr 13 23:25:40 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:25:40 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:25:40 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:25:40 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:25:40 user nova-compute[71269]:   </clock>
Apr 13 23:25:40 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:25:40 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:25:40 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:25:40 user nova-compute[71269]:   </cpu>
Apr 13 23:25:40 user nova-compute[71269]:   <devices>
Apr 13 23:25:40 user nova-compute[71269]:     <disk type="block" device="disk">
Apr 13 23:25:40 user nova-compute[71269]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 23:25:40 user nova-compute[71269]:       <source dev="/dev/sdb"/>
Apr 13 23:25:40 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:25:40 user nova-compute[71269]:       <serial>78d07dc5-246c-4db0-a870-2beebf4310a9</serial>
Apr 13 23:25:40 user nova-compute[71269]:     </disk>
Apr 13 23:25:40 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:25:40 user nova-compute[71269]:       <mac address="fa:16:3e:81:c4:d9"/>
Apr 13 23:25:40 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:25:40 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:25:40 user nova-compute[71269]:       <target dev="tap32c825d8-b7"/>
Apr 13 23:25:40 user nova-compute[71269]:     </interface>
Apr 13 23:25:40 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:25:40 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04/console.log" append="off"/>
Apr 13 23:25:40 user nova-compute[71269]:     </serial>
Apr 13 23:25:40 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:25:40 user nova-compute[71269]:     <video>
Apr 13 23:25:40 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:25:40 user nova-compute[71269]:     </video>
Apr 13 23:25:40 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:25:40 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:25:40 user nova-compute[71269]:     </rng>
Apr 13 23:25:40 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:25:40 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:25:40 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:25:40 user nova-compute[71269]:     </memballoon>
Apr 13 23:25:40 user nova-compute[71269]:   </devices>
Apr 13 23:25:40 user nova-compute[71269]: </domain>
Apr 13 23:25:40 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1845632989-network", "vif_mac": "fa:16:3e:81:c4:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG os_vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c825d8-b7, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c825d8-b7, col_values=(('external_ids', {'iface-id': '32c825d8-b7d0-42c1-b8bd-49b1d35821f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:c4:d9', 'vm-uuid': '0ba1c8fe-0485-4d72-b82a-354c2b21ce04'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:40 user nova-compute[71269]: INFO os_vif [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7')
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:25:40 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] No VIF found with MAC fa:16:3e:81:c4:d9, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG nova.compute.manager [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:25:41 user nova-compute[71269]: WARNING nova.compute.manager [req-7841a13f-6471-4997-8924-76c74b8263cd req-54d84cf2-6da4-4c01-9b28-46a3c16222ae service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state resize_finish.
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:25:43 user nova-compute[71269]: WARNING nova.compute.manager [req-0286689d-3ba2-4783-92d5-72c1c6822412 req-fc4e3971-6daa-43ea-8a0d-ad38426f31fa service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state resize_finish.
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.host [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Removed pending event for 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 due to event {{(pid=71269) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428343.7719936, 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:25:43 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] VM Resumed (Lifecycle Event)
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:25:43 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance running successfully.
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.guest [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Failed to set time: agent not configured {{(pid=71269) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-85557ff0-373b-41fc-831b-1031348b2817 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] finish_migration finished successfully. {{(pid=71269) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:25:43 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428343.7766402, 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:25:43 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] VM Started (Lifecycle Event)
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:25:43 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:25:43 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 23:25:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:25:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:25:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:26:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:11 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:26:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:26:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:26:13 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=26.20073699951172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Applying migration context for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 as it has an incoming, in-progress migration 8e591da0-2c17-4dd7-a79e-758889ca5874. Migration status is finished {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 23:26:13 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating resource usage from migration 8e591da0-2c17-4dd7-a79e-758889ca5874
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Migration 8e591da0-2c17-4dd7-a79e-758889ca5874 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:26:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:26:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:18 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:26:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:26:23 user nova-compute[71269]: DEBUG nova.compute.manager [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing instance network info cache due to event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:26:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:26:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:26:23 user nova-compute[71269]: DEBUG nova.network.neutron [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:26:24 user nova-compute[71269]: DEBUG nova.network.neutron [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updated VIF entry in instance network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:26:24 user nova-compute[71269]: DEBUG nova.network.neutron [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:26:24 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-51e3ccb6-5d7f-4824-bf06-7c9c7c19f74c req-959889f0-3c61-4113-b292-95168040427c service nova] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:26:24 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:27 user nova-compute[71269]: INFO nova.compute.manager [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Shelving
Apr 13 23:26:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:26:27 user nova-compute[71269]: WARNING nova.compute.manager [req-0fc22885-c67f-477a-a981-3ef0b4518bda req-91a8caf6-9e5d-4e17-b710-6a98b8d57b11 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state active and task_state shelving.
Apr 13 23:26:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance destroyed successfully.
Apr 13 23:26:27 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Beginning cold snapshot process
Apr 13 23:26:28 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:26:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk /opt/stack/data/nova/instances/snapshots/tmpxz5d5h4i/3081df144c274701b59090cda8f1448e {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:26:28 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk /opt/stack/data/nova/instances/snapshots/tmpxz5d5h4i/3081df144c274701b59090cda8f1448e" returned: 0 in 0.496s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:26:28 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Snapshot extracted, beginning image upload
Apr 13 23:26:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:26:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:26:29 user nova-compute[71269]: WARNING nova.compute.manager [req-0f1ea1bc-a3e8-413b-ac74-025b46c94ce8 req-5f05d1f7-e939-47ef-92dc-6ae96c8c7864 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 23:26:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Snapshot image upload complete
Apr 13 23:26:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:26:30 user nova-compute[71269]: INFO nova.compute.manager [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Shelve offloading
Apr 13 23:26:30 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance destroyed successfully.
Apr 13 23:26:30 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:26:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:26:30 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:26:30 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.network.neutron [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:26:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance destroyed successfully.
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'resources' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvYa/qbohXL8t77LIIOS/oHQFIJOy9DvFTUSwa5laQz6hTF++BR/SJDTRnkzuy3ekPDiP1NzkwecHGwm8X+Lr9Sv3GYLMebgTDhY9CiZp0mH5fK3XDLzfE8aE5qXvlzaA==',key_name='tempest-keypair-1255905063',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:26:30.704159',shelved_host='user',shelved_image_id='c5f7776f-99aa-4f09-a0e5-8716c64fdd4f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG os_vif [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35f2f7df-89, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.compute.manager [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing instance network info cache due to event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG nova.network.neutron [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:26:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:31 user nova-compute[71269]: INFO os_vif [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89')
Apr 13 23:26:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Deleting instance files /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a_del
Apr 13 23:26:31 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Deletion of /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a_del complete
Apr 13 23:26:31 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Deleted allocations for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a
Apr 13 23:26:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG nova.objects.instance [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'numa_topology' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-5af581de-7edf-4a42-bfa2-8069b1a7bf70 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.116s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updated VIF entry in instance network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG nova.network.neutron [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap35f2f7df-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:26:32 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-41749224-0efa-4a7f-aa16-5129566abe22 req-cb0299f6-3cde-4f5c-a46e-7c9cacaa81ba service nova] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:26:34 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:39 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:42 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428387.9104683, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:26:42 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Stopped (Lifecycle Event)
Apr 13 23:26:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-5ff470eb-73b1-4be2-aa8e-3430c39d3772 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:26:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:26:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:04 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:10 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:27:11 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:27:12 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:27:12 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=26.175674438476562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Applying migration context for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 as it has an incoming, in-progress migration 8e591da0-2c17-4dd7-a79e-758889ca5874. Migration status is finished {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 23:27:12 user nova-compute[71269]: INFO nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating resource usage from migration 8e591da0-2c17-4dd7-a79e-758889ca5874
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Migration 8e591da0-2c17-4dd7-a79e-758889ca5874 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:27:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:27:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:27:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 23:27:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:27:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:17 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:17 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.compute.manager [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Going to confirm migration 2 {{(pid=71269) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'info_cache' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.network.neutron [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'migration_context' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:27:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.198s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:27:21 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Deleted allocation for migration 8e591da0-2c17-4dd7-a79e-758889ca5874
Apr 13 23:27:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-1e04ac6f-2f5e-48e6-b46a-e9b808d9adbd tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.096s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:21 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:22 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:27:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:27:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:12 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:12 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:28:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:28:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:14 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:28:15 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:28:15 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=26.175003051757812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=832MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:28:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:18 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:19 user nova-compute[71269]: INFO nova.compute.manager [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Unshelving
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:19 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_requests' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'numa_topology' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71269) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 23:28:20 user nova-compute[71269]: INFO nova.compute.claims [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Claim successful on node user
Apr 13 23:28:20 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:20 user nova-compute[71269]: INFO nova.network.neutron [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating port 35f2f7df-8994-44fe-af00-26d1a8f24c83 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Building network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.compute.manager [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing instance network info cache due to event network-changed-35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Acquiring lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.network.neutron [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Creating instance directory {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 23:28:21 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Creating image(s)
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'trusted_certs' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Acquired lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG nova.network.neutron [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Refreshing network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:21 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.part --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG nova.virt.images [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] c5f7776f-99aa-4f09-a0e5-8716c64fdd4f was qcow2, converting to raw {{(pid=71269) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG nova.privsep.utils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71269) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.part /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.converted {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updated VIF entry in instance network info cache for port 35f2f7df-8994-44fe-af00-26d1a8f24c83. {{(pid=71269) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG nova.network.neutron [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-fae552f3-d227-4797-b072-ea62f36c9273 req-b7895283-acae-48b5-894c-4f35d67f69ac service nova] Releasing lock "refresh_cache-f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.part /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.converted" returned: 0 in 0.413s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:22 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.converted --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.545s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json" returned: 0 in 0.157s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json" returned: 0 in 0.129s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1,backing_fmt=raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk 1073741824 {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1,backing_fmt=raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk 1073741824" returned: 0 in 0.046s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "24ed322df94cc307ba1cc3e5699d869787a3e6a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'migration_context' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:23 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Rebasing disk image.
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f --force-share --output=json" returned: 0 in 0.130s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:23 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f -F raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f -F raw /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk" returned: 0 in 1.959s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Created local disks {{(pid=71269) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Ensure instance console log exists: /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/console.log {{(pid=71269) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start _get_guest_xml network_info=[{"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='13aaf76ca29355f98acb0fa803a3a52e',container_format='bare',created_at=2023-04-13T23:26:27Z,direct_url=<?>,disk_format='qcow2',id=c5f7776f-99aa-4f09-a0e5-8716c64fdd4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-275106454-shelved',owner='b9ad0d0e72ad43cca506267d62269910',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T23:26:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'image_id': 'd6970ace-53c3-48ed-ae08-e4c3846a312a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 23:28:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:28:25 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71269) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T22:50:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='13aaf76ca29355f98acb0fa803a3a52e',container_format='bare',created_at=2023-04-13T23:26:27Z,direct_url=<?>,disk_format='qcow2',id=c5f7776f-99aa-4f09-a0e5-8716c64fdd4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-275106454-shelved',owner='b9ad0d0e72ad43cca506267d62269910',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T23:26:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image limits 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Flavor pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Image pref 0:0:0 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Got 1 possible topologies {{(pid=71269) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.hardware [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71269) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'vcpu_model' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='c5f7776f-99aa-4f09-a0e5-8716c64fdd4f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1255905063',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:26:30.704159',shelved_host='user',shelved_image_id='c5f7776f-99aa-4f09-a0e5-8716c64fdd4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:28:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71269) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.objects.instance [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'pci_devices' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 23:28:25 user nova-compute[71269]:   <uuid>f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</uuid>
Apr 13 23:28:25 user nova-compute[71269]:   <name>instance-0000002f</name>
Apr 13 23:28:25 user nova-compute[71269]:   <memory>131072</memory>
Apr 13 23:28:25 user nova-compute[71269]:   <vcpu>1</vcpu>
Apr 13 23:28:25 user nova-compute[71269]:   <metadata>
Apr 13 23:28:25 user nova-compute[71269]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 23:28:25 user nova-compute[71269]:       <nova:package version="0.0.0"/>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-275106454</nova:name>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:creationTime>2023-04-13 23:28:25</nova:creationTime>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:flavor name="m1.nano">
Apr 13 23:28:25 user nova-compute[71269]:         <nova:memory>128</nova:memory>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:disk>1</nova:disk>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:swap>0</nova:swap>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:vcpus>1</nova:vcpus>
Apr 13 23:28:25 user nova-compute[71269]:       </nova:flavor>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:owner>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:user uuid="e66f624501c3404bb1eb9412a8a6c951">tempest-AttachVolumeShelveTestJSON-953327095-project-member</nova:user>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:project uuid="b9ad0d0e72ad43cca506267d62269910">tempest-AttachVolumeShelveTestJSON-953327095</nova:project>
Apr 13 23:28:25 user nova-compute[71269]:       </nova:owner>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:root type="image" uuid="c5f7776f-99aa-4f09-a0e5-8716c64fdd4f"/>
Apr 13 23:28:25 user nova-compute[71269]:       <nova:ports>
Apr 13 23:28:25 user nova-compute[71269]:         <nova:port uuid="35f2f7df-8994-44fe-af00-26d1a8f24c83">
Apr 13 23:28:25 user nova-compute[71269]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 23:28:25 user nova-compute[71269]:         </nova:port>
Apr 13 23:28:25 user nova-compute[71269]:       </nova:ports>
Apr 13 23:28:25 user nova-compute[71269]:     </nova:instance>
Apr 13 23:28:25 user nova-compute[71269]:   </metadata>
Apr 13 23:28:25 user nova-compute[71269]:   <sysinfo type="smbios">
Apr 13 23:28:25 user nova-compute[71269]:     <system>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="product">OpenStack Nova</entry>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="version">0.0.0</entry>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="serial">f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</entry>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="uuid">f06f6eff-76a8-4c0a-9e11-b49b0c09e22a</entry>
Apr 13 23:28:25 user nova-compute[71269]:       <entry name="family">Virtual Machine</entry>
Apr 13 23:28:25 user nova-compute[71269]:     </system>
Apr 13 23:28:25 user nova-compute[71269]:   </sysinfo>
Apr 13 23:28:25 user nova-compute[71269]:   <os>
Apr 13 23:28:25 user nova-compute[71269]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 23:28:25 user nova-compute[71269]:     <boot dev="hd"/>
Apr 13 23:28:25 user nova-compute[71269]:     <smbios mode="sysinfo"/>
Apr 13 23:28:25 user nova-compute[71269]:   </os>
Apr 13 23:28:25 user nova-compute[71269]:   <features>
Apr 13 23:28:25 user nova-compute[71269]:     <acpi/>
Apr 13 23:28:25 user nova-compute[71269]:     <apic/>
Apr 13 23:28:25 user nova-compute[71269]:     <vmcoreinfo/>
Apr 13 23:28:25 user nova-compute[71269]:   </features>
Apr 13 23:28:25 user nova-compute[71269]:   <clock offset="utc">
Apr 13 23:28:25 user nova-compute[71269]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 23:28:25 user nova-compute[71269]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 23:28:25 user nova-compute[71269]:     <timer name="hpet" present="no"/>
Apr 13 23:28:25 user nova-compute[71269]:   </clock>
Apr 13 23:28:25 user nova-compute[71269]:   <cpu mode="custom" match="exact">
Apr 13 23:28:25 user nova-compute[71269]:     <model>Nehalem</model>
Apr 13 23:28:25 user nova-compute[71269]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 23:28:25 user nova-compute[71269]:   </cpu>
Apr 13 23:28:25 user nova-compute[71269]:   <devices>
Apr 13 23:28:25 user nova-compute[71269]:     <disk type="file" device="disk">
Apr 13 23:28:25 user nova-compute[71269]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 23:28:25 user nova-compute[71269]:       <source file="/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk"/>
Apr 13 23:28:25 user nova-compute[71269]:       <target dev="vda" bus="virtio"/>
Apr 13 23:28:25 user nova-compute[71269]:     </disk>
Apr 13 23:28:25 user nova-compute[71269]:     <interface type="ethernet">
Apr 13 23:28:25 user nova-compute[71269]:       <mac address="fa:16:3e:26:43:06"/>
Apr 13 23:28:25 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:28:25 user nova-compute[71269]:       <mtu size="1442"/>
Apr 13 23:28:25 user nova-compute[71269]:       <target dev="tap35f2f7df-89"/>
Apr 13 23:28:25 user nova-compute[71269]:     </interface>
Apr 13 23:28:25 user nova-compute[71269]:     <serial type="pty">
Apr 13 23:28:25 user nova-compute[71269]:       <log file="/opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/console.log" append="off"/>
Apr 13 23:28:25 user nova-compute[71269]:     </serial>
Apr 13 23:28:25 user nova-compute[71269]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 23:28:25 user nova-compute[71269]:     <video>
Apr 13 23:28:25 user nova-compute[71269]:       <model type="virtio"/>
Apr 13 23:28:25 user nova-compute[71269]:     </video>
Apr 13 23:28:25 user nova-compute[71269]:     <rng model="virtio">
Apr 13 23:28:25 user nova-compute[71269]:       <backend model="random">/dev/urandom</backend>
Apr 13 23:28:25 user nova-compute[71269]:     </rng>
Apr 13 23:28:25 user nova-compute[71269]:     <controller type="usb" index="0" model="none"/>
Apr 13 23:28:25 user nova-compute[71269]:     <memballoon model="virtio">
Apr 13 23:28:25 user nova-compute[71269]:       <stats period="10"/>
Apr 13 23:28:25 user nova-compute[71269]:     </memballoon>
Apr 13 23:28:25 user nova-compute[71269]:   </devices>
Apr 13 23:28:25 user nova-compute[71269]: </domain>
Apr 13 23:28:25 user nova-compute[71269]:  {{(pid=71269) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='c5f7776f-99aa-4f09-a0e5-8716c64fdd4f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1255905063',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member',shelved_at='2023-04-13T23:26:30.704159',shelved_host='user',shelved_image_id='c5f7776f-99aa-4f09-a0e5-8716c64fdd4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T23:28:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG os_vif [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35f2f7df-89, may_exist=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35f2f7df-89, col_values=(('external_ids', {'iface-id': '35f2f7df-8994-44fe-af00-26d1a8f24c83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:43:06', 'vm-uuid': 'f06f6eff-76a8-4c0a-9e11-b49b0c09e22a'}),)) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:25 user nova-compute[71269]: INFO os_vif [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89')
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No BDM found with device name vda, not building metadata. {{(pid=71269) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 23:28:25 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] No VIF found with MAC fa:16:3e:26:43:06, not building metadata {{(pid=71269) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG nova.compute.manager [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:28:27 user nova-compute[71269]: WARNING nova.compute.manager [req-2601ca61-e169-4ebb-bc2e-8a9083e648b7 req-b7709feb-0159-4deb-9498-d2484f98c7ae service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428509.49489, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Resumed> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:28:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Resumed (Lifecycle Event)
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance event wait completed in 0 seconds for  {{(pid=71269) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Guest created on hypervisor {{(pid=71269) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:29 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance spawned successfully.
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:28:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.virt.driver [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] Emitting event <LifecycleEvent: 1681428509.499093, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Started> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:28:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Started (Lifecycle Event)
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71269) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 23:28:29 user nova-compute[71269]: INFO nova.compute.manager [None req-57165f00-bdb3-4900-a239-e48067fe8de6 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:28:29 user nova-compute[71269]: WARNING nova.compute.manager [req-10dbe5eb-0ab8-4775-b7cb-45f4296e6338 req-dc4e3fe5-8cb8-491c-86d6-e1db5522ec66 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 23:28:29 user nova-compute[71269]: DEBUG nova.compute.manager [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:28:29 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-13dec4c1-0f09-4d75-8a98-ecb3c9961aa7 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.900s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:30 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:35 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Verify base images {{(pid=71269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Image id d6970ace-53c3-48ed-ae08-e4c3846a312a yields fingerprint 649f6a896c807bc1a36cb3d587aeca2ec6274c3f {{(pid=71269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 23:28:37 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] image d6970ace-53c3-48ed-ae08-e4c3846a312a at (/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f): checking
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] image d6970ace-53c3-48ed-ae08-e4c3846a312a at (/opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f): image is in use {{(pid=71269) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] b5af8749-cd19-4828-b6f6-e3628da12f01 is a valid instance name {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] b5af8749-cd19-4828-b6f6-e3628da12f01 has a disk file {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 23:28:37 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 is backed by 649f6a896c807bc1a36cb3d587aeca2ec6274c3f {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 is a valid instance name {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] f06f6eff-76a8-4c0a-9e11-b49b0c09e22a is a valid instance name {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] f06f6eff-76a8-4c0a-9e11-b49b0c09e22a has a disk file {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a is backed by 649f6a896c807bc1a36cb3d587aeca2ec6274c3f {{(pid=71269) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4
Apr 13 23:28:38 user nova-compute[71269]: WARNING nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Active base files: /opt/stack/data/nova/instances/_base/649f6a896c807bc1a36cb3d587aeca2ec6274c3f
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Removable base files: /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358 /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3 /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380 /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931 /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04 /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1 /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4 /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba2f6ab5c991162cda6e923ff37e1f57e3262358
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3300c2c96974d830ea27d8f78626831860c8a0d3
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e3bbbc23616c746675abe69138828b7608af7fc
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/66ba419dc26519768d5c83fd82fea7077722e380
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3fb3fdc21b1f4eb137b4cd6f7e32b63a70c17931
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3870c1914c8c2405ed4bbb8fe233b99ef44dc04
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/24ed322df94cc307ba1cc3e5699d869787a3e6a1
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d99a82db9ff80d9f5cded0c9c940406de8f15f4
Apr 13 23:28:38 user nova-compute[71269]: INFO nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7455f69690b09a411abe9b4f7fd395cf182c3720
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Verification complete {{(pid=71269) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Verify swap images {{(pid=71269) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 23:28:38 user nova-compute[71269]: DEBUG nova.virt.libvirt.imagecache [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Verify ephemeral images {{(pid=71269) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 23:28:40 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:44 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:45 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:50 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:28:55 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:28:59 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:00 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:05 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:07 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:08 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 23:29:08 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] There are 0 instances to clean {{(pid=71269) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 23:29:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:10 user nova-compute[71269]: INFO nova.compute.manager [None req-5f239553-9dfb-4e44-9908-df476099f9e9 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Get console output
Apr 13 23:29:11 user nova-compute[71269]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 23:29:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:29:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:29:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:29:13 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:29:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [{"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-0ba1c8fe-0485-4d72-b82a-354c2b21ce04" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71269) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:29:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:29:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=26.156517028808594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:29:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:29:19 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:21 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:21 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:21 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:21 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Cleaning up deleted instances with incomplete migration  {{(pid=71269) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 23:29:22 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:23 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:26 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:31 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:36 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:41 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_power_states {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Triggering sync for uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:29:42 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:46 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:29:51 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:29:54 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:29:56 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:01 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:30:06 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:10 user nova-compute[71269]: INFO nova.compute.manager [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Terminating instance
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.compute.manager [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.compute.manager [req-0f7a0279-1ca0-4cf5-86b7-e0310f2c3ab5 req-6bfaaed9-5f13-4f6d-9a77-82f33c108308 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-unplugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:10 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Instance destroyed successfully.
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.objects.instance [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lazy-loading 'resources' on Instance uuid f06f6eff-76a8-4c0a-9e11-b49b0c09e22a {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T23:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-275106454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-275106454',id=47,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvYa/qbohXL8t77LIIOS/oHQFIJOy9DvFTUSwa5laQz6hTF++BR/SJDTRnkzuy3ekPDiP1NzkwecHGwm8X+Lr9Sv3GYLMebgTDhY9CiZp0mH5fK3XDLzfE8aE5qXvlzaA==',key_name='tempest-keypair-1255905063',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ad0d0e72ad43cca506267d62269910',ramdisk_id='',reservation_id='r-ex81y8dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-953327095',owner_user_name='tempest-AttachVolumeShelveTestJSON-953327095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e66f624501c3404bb1eb9412a8a6c951',uuid=f06f6eff-76a8-4c0a-9e11-b49b0c09e22a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converting VIF {"id": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "address": "fa:16:3e:26:43:06", "network": {"id": "63f2f5eb-5e4d-439f-b38d-a0d5b96c5301", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-38471244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ad0d0e72ad43cca506267d62269910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f2f7df-89", "ovs_interfaceid": "35f2f7df-8994-44fe-af00-26d1a8f24c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:30:10 user nova-compute[71269]: DEBUG os_vif [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35f2f7df-89, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: INFO os_vif [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:43:06,bridge_name='br-int',has_traffic_filtering=True,id=35f2f7df-8994-44fe-af00-26d1a8f24c83,network=Network(63f2f5eb-5e4d-439f-b38d-a0d5b96c5301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f2f7df-89')
Apr 13 23:30:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Deleting instance files /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a_del
Apr 13 23:30:11 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Deletion of /opt/stack/data/nova/instances/f06f6eff-76a8-4c0a-9e11-b49b0c09e22a_del complete
Apr 13 23:30:11 user nova-compute[71269]: INFO nova.compute.manager [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:11 user nova-compute[71269]: INFO nova.compute.manager [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Terminating instance
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.compute.manager [req-a6e312eb-3234-43e6-81b6-164f91f0a14d req-883d461f-3ba6-4a0e-b022-68b29836d99d service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-unplugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:11 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:30:11 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Took 0.85 seconds to deallocate network for instance.
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-64d45143-de53-4990-8f99-a3b062f7e801 req-d0645ef7-ab60-46d2-94bd-30207bac1c73 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-deleted-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:12 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Deleted allocations for instance f06f6eff-76a8-4c0a-9e11-b49b0c09e22a
Apr 13 23:30:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Instance destroyed successfully.
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.objects.instance [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1208753564',display_name='tempest-ServerActionsTestJSON-server-1208753564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1208753564',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-nbw3gvkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:27:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=0ba1c8fe-0485-4d72-b82a-354c2b21ce04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "address": "fa:16:3e:81:c4:d9", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c825d8-b7", "ovs_interfaceid": "32c825d8-b7d0-42c1-b8bd-49b1d35821f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_vif [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c825d8-b7, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-681c024f-a619-45e6-91bf-777284f6e437 tempest-AttachVolumeShelveTestJSON-953327095 tempest-AttachVolumeShelveTestJSON-953327095-project-member] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:12 user nova-compute[71269]: INFO os_vif [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:c4:d9,bridge_name='br-int',has_traffic_filtering=True,id=32c825d8-b7d0-42c1-b8bd-49b1d35821f9,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c825d8-b7')
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] calling os-brick to detach iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3bc33e6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIspgyBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 23:30:12 user nova-compute[71269]: WARNING os_brick.initiator.connectors.base [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e611976-7f5e-409a-a5a7-e53443533196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 23:30:12 user nova-compute[71269]: No targets found.
Apr 13 23:30:12 user nova-compute[71269]: iSNS:
Apr 13 23:30:12 user nova-compute[71269]: No targets found.
Apr 13 23:30:12 user nova-compute[71269]: STATIC:
Apr 13 23:30:12 user nova-compute[71269]: Target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9
Apr 13 23:30:12 user nova-compute[71269]:         Portal: 172.16.0.220:3260,-1
Apr 13 23:30:12 user nova-compute[71269]:                 Iface Name: default
Apr 13 23:30:12 user nova-compute[71269]: FIRMWARE:
Apr 13 23:30:12 user nova-compute[71269]: No targets found.
Apr 13 23:30:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 23:30:12 user nova-compute[71269]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 23:30:12 user nova-compute[71269]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71269) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9', 0)] {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284028f-fb4d-412c-8088-d516150eba04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be16f9e-73b9-4b78-bafe-3cf86fc803d7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:30:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 (non-flash)
Apr 13 23:30:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd37c7d7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9'): ({'sdb'}, set())}) {{(pid=71269) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Removing single pathed devices sdb {{(pid=71269) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4828ca2-f046-4a9f-a778-d0b8a4bbc1bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffcad17-d493-4ee5-a1c5-6730212f735c]: (4, ('ok\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Flushing IO for device /dev/sdb {{(pid=71269) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f9f6b8-eb90-4608-991c-3caf9184428f]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71269) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[26243e21-f6b5-4d86-9150-af73da4b8f59]: (4, ('1', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.linuxscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] SCSI volumes sdb have been removed. {{(pid=71269) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6607a11b-5403db0cad8da98d', '/dev/disk/by-id/scsi-23534303364623063', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6607a11b') {{(pid=81834) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[daecf29a-5d8c-4783-9490-eb91ac4dc499]: (4, None) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9')] {{(pid=71269) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d88840-a333-4695-acab-155d76468b60]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --logout {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Acquiring lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] Lock "f06f6eff-76a8-4c0a-9e11-b49b0c09e22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.compute.manager [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] No waiting events found dispatching network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:30:12 user nova-compute[71269]: WARNING nova.compute.manager [req-04575fb4-fef2-422d-a499-7894b6f39c9d req-8fd7cff8-6d4f-4335-82ec-b3dde1658996 service nova] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Received unexpected event network-vif-plugged-35f2f7df-8994-44fe-af00-26d1a8f24c83 for instance with vm_state deleted and task_state None.
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0d072-c2fc-41bc-a8e0-8399f46758aa]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260]
Apr 13 23:30:12 user nova-compute[71269]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9, portal: 172.16.0.220,3260] successful.
Apr 13 23:30:12 user nova-compute[71269]:  stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op delete {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d07dc5-246c-4db0-a870-2beebf4310a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81834) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f8ed7-9948-447d-8579-52924cefc813]: (4, ('', '')) {{(pid=81834) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71269) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.base [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] <== disconnect_volume: return (264ms) None {{(pid=71269) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Disconnected iSCSI Volume {{(pid=71269) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 23:30:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Deleting instance files /opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04_del
Apr 13 23:30:12 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Deletion of /opt/stack/data/nova/instances/0ba1c8fe-0485-4d72-b82a-354c2b21ce04_del complete
Apr 13 23:30:12 user nova-compute[71269]: INFO nova.compute.manager [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 13 23:30:12 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:30:12 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:30:13 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Took 0.70 seconds to deallocate network for instance.
Apr 13 23:30:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Acquiring lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:13 user nova-compute[71269]: DEBUG nova.compute.manager [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] No waiting events found dispatching network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:30:13 user nova-compute[71269]: WARNING nova.compute.manager [req-ca8c29ad-6a6d-499f-be87-28386faf45d7 req-53c7cb32-f966-4c41-a932-5853d5e36f62 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received unexpected event network-vif-plugged-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 for instance with vm_state active and task_state deleting.
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.manager [req-4b717c7d-8e88-494d-b5a9-37426d9b7361 req-7cc4d1e8-3df0-4b57-a12b-685abe8b2622 service nova] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Received event network-vif-deleted-32c825d8-b7d0-42c1-b8bd-49b1d35821f9 {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:30:14 user nova-compute[71269]: INFO nova.compute.manager [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Took 0.75 seconds to detach 1 volumes for instance.
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Deleting volume: 78d07dc5-246c-4db0-a870-2beebf4310a9 {{(pid=71269) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Refreshing inventories for resource provider e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Updating ProviderTree inventory for provider e216f943-de42-42dc-843a-799496cf2730 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Updating inventory in ProviderTree for provider e216f943-de42-42dc-843a-799496cf2730 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Refreshing aggregate associations for resource provider e216f943-de42-42dc-843a-799496cf2730, aggregates: None {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Refreshing trait associations for resource provider e216f943-de42-42dc-843a-799496cf2730, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71269) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:14 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Deleted allocations for instance 0ba1c8fe-0485-4d72-b82a-354c2b21ce04
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-b98a0f01-85be-490d-bc17-1095612ce704 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "0ba1c8fe-0485-4d72-b82a-354c2b21ce04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquired lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Forcefully refreshing network info cache for instance {{(pid=71269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 23:30:14 user nova-compute[71269]: DEBUG nova.objects.instance [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lazy-loading 'info_cache' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG nova.network.neutron [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [{"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Releasing lock "refresh_cache-b5af8749-cd19-4828-b6f6-e3628da12f01" {{(pid=71269) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updated the network info_cache for instance {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:30:15 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.processutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71269) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 23:30:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:30:16 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=26.175357818603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Instance b5af8749-cd19-4828-b6f6-e3628da12f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71269) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:30:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:30:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:23 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:24 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:24 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:30:25 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428610.9725053, f06f6eff-76a8-4c0a-9e11-b49b0c09e22a => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:30:25 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] VM Stopped (Lifecycle Event)
Apr 13 23:30:25 user nova-compute[71269]: DEBUG nova.compute.manager [None req-d1297480-e6b8-4118-b7a5-643373e3b496 None None] [instance: f06f6eff-76a8-4c0a-9e11-b49b0c09e22a] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:30:27 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428612.3305347, 0ba1c8fe-0485-4d72-b82a-354c2b21ce04 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:30:27 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] VM Stopped (Lifecycle Event)
Apr 13 23:30:27 user nova-compute[71269]: DEBUG nova.compute.manager [None req-ce4f862e-bf7b-44fc-bb9d-7bd6a740b995 None None] [instance: 0ba1c8fe-0485-4d72-b82a-354c2b21ce04] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:30:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:49 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:30:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:02 user nova-compute[71269]: INFO nova.compute.manager [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Terminating instance
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.compute.manager [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Start destroying the instance on the hypervisor. {{(pid=71269) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-unplugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] No waiting events found dispatching network-vif-unplugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.compute.manager [req-beecb322-d220-4d72-8243-d2dba1040444 req-77827646-ab9d-4efc-b93f-1ec820b483b6 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-unplugged-1f5d0400-132c-4746-9b98-a86dfc3511af for instance with task_state deleting. {{(pid=71269) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 23:31:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Instance destroyed successfully.
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.objects.instance [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lazy-loading 'resources' on Instance uuid b5af8749-cd19-4828-b6f6-e3628da12f01 {{(pid=71269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.virt.libvirt.vif [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T23:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-545240224',display_name='tempest-ServerActionsTestJSON-server-545240224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-545240224',id=45,image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2EFnEC+MjQ8MN7/h8lbEDqJSZUgI17qN6UyZSFWEYomT0Y8/R1pnQthM9zqr77l9PBtP9KbCTmAZuTTFTS56/ux9Fx7kZmDpwrq+me+dJT+NaGwsp3SY5YpEAcd8tVtA==',key_name='tempest-keypair-1382560979',keypairs=<?>,launch_index=0,launched_at=2023-04-13T23:21:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68330047a5fd4e4397cf5edca18c5b51',ramdisk_id='',reservation_id='r-35my7br9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d6970ace-53c3-48ed-ae08-e4c3846a312a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-372556233',owner_user_name='tempest-ServerActionsTestJSON-372556233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T23:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59b2c11a23384f678a086de89139497d',uuid=b5af8749-cd19-4828-b6f6-e3628da12f01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converting VIF {"id": "1f5d0400-132c-4746-9b98-a86dfc3511af", "address": "fa:16:3e:b3:f5:1f", "network": {"id": "85b04a3c-80c1-4d43-9e13-6f8de7286808", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1845632989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68330047a5fd4e4397cf5edca18c5b51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d0400-13", "ovs_interfaceid": "1f5d0400-132c-4746-9b98-a86dfc3511af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.network.os_vif_util [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13') {{(pid=71269) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG os_vif [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13') {{(pid=71269) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f5d0400-13, bridge=br-int, if_exists=True) {{(pid=71269) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:02 user nova-compute[71269]: INFO os_vif [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=1f5d0400-132c-4746-9b98-a86dfc3511af,network=Network(85b04a3c-80c1-4d43-9e13-6f8de7286808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d0400-13')
Apr 13 23:31:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Deleting instance files /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01_del
Apr 13 23:31:02 user nova-compute[71269]: INFO nova.virt.libvirt.driver [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Deletion of /opt/stack/data/nova/instances/b5af8749-cd19-4828-b6f6-e3628da12f01_del complete
Apr 13 23:31:02 user nova-compute[71269]: INFO nova.compute.manager [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 23:31:02 user nova-compute[71269]: DEBUG oslo.service.loopingcall [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71269) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.compute.manager [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Deallocating network for instance {{(pid=71269) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 23:31:02 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] deallocate_for_instance() {{(pid=71269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG nova.network.neutron [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Updating instance_info_cache with network_info: [] {{(pid=71269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 23:31:03 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Took 0.47 seconds to deallocate network for instance.
Apr 13 23:31:03 user nova-compute[71269]: DEBUG nova.compute.manager [req-dce39bc0-180a-4ea4-9100-6a3627bf7e7d req-bbc0b952-9484-43a2-bd22-fc6226430c04 service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-deleted-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:31:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:03 user nova-compute[71269]: INFO nova.scheduler.client.report [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Deleted allocations for instance b5af8749-cd19-4828-b6f6-e3628da12f01
Apr 13 23:31:03 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-bc3db9f4-ab81-4b7c-8069-b4b72255d3f2 tempest-ServerActionsTestJSON-372556233 tempest-ServerActionsTestJSON-372556233-project-member] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.631s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 23:31:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Acquiring lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:04 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] Lock "b5af8749-cd19-4828-b6f6-e3628da12f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:04 user nova-compute[71269]: DEBUG nova.compute.manager [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] No waiting events found dispatching network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af {{(pid=71269) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 23:31:04 user nova-compute[71269]: WARNING nova.compute.manager [req-9d746801-3a9f-4e24-add4-bb9cee64475b req-3f5b3d8f-1838-4093-afe2-b86eee60633a service nova] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Received unexpected event network-vif-plugged-1f5d0400-132c-4746-9b98-a86dfc3511af for instance with vm_state deleted and task_state None.
Apr 13 23:31:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:09 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:31:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:31:17 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:31:17 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=26.193588256835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681428662.8053606, b5af8749-cd19-4828-b6f6-e3628da12f01 => Stopped> {{(pid=71269) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 23:31:17 user nova-compute[71269]: INFO nova.compute.manager [-] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] VM Stopped (Lifecycle Event)
Apr 13 23:31:17 user nova-compute[71269]: DEBUG nova.compute.manager [None req-cd07cd25-9a96-42c2-93a7-6e26648aaffc None None] [instance: b5af8749-cd19-4828-b6f6-e3628da12f01] Checking state {{(pid=71269) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 23:31:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:19 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:31:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:24 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:24 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:25 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:26 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:26 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:31:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:42 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71269) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71269) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 23:31:47 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:52 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:31:57 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:02 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:03 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:07 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:12 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:14 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Starting heal instance info cache {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 23:32:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Rebuilding the list of instances to heal {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 23:32:14 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Didn't find any instances for network info cache update. {{(pid=71269) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 23:32:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:15 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:15 user nova-compute[71269]: DEBUG nova.compute.manager [None req-483e6792-e455-445c-a159-c0029dcc400c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71269) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 23:32:16 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager.update_available_resource {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:32:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:32:16 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:32:16 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Auditing locally available compute resources for user (node: user) {{(pid=71269) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 23:32:17 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:32:17 user nova-compute[71269]: WARNING nova.virt.libvirt.driver [None req-483e6792-e455-445c-a159-c0029dcc400c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=26.182220458984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71269) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71269) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.compute.provider_tree [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed in ProviderTree for provider: e216f943-de42-42dc-843a-799496cf2730 {{(pid=71269) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.scheduler.client.report [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Inventory has not changed for provider e216f943-de42-42dc-843a-799496cf2730 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71269) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG nova.compute.resource_tracker [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Compute_service record updated for user:user {{(pid=71269) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG oslo_concurrency.lockutils [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=71269) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 23:32:17 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 23:32:20 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:21 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:22 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:32:24 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:25 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:26 user nova-compute[71269]: DEBUG oslo_service.periodic_task [None req-483e6792-e455-445c-a159-c0029dcc400c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71269) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 23:32:27 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:32:32 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 23:32:37 user nova-compute[71269]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71269) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}